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1. Introduction 

The two-point correlation function is a fundamental statistic for 
characterizing the galaxy distribution. It partly quantifies the vi- 
sual impression of clustering provided by the redshift maps, and 
subsequently allows one to perform direct comparison with the 
theoretical predictions. One of the issues is to determine how 
galaxies trace the underlying mass distribution, and whether and 
how this is related to their internal properties. This in turn can 
provide crucial information on how galaxies have formed and 
evolved until now. 

Here we use the E SO-Sculptor Survey (hereafter ESS; 
Ide Lapparent et alll2003l) to statistically characterize the large- 
scale clustering of galaxies at z 0.5, and to examine its 
dependence on galaxy type. The ESS provides a nearly com- 
plete redshift s urvey of galaxies at z ^ 0.5 over a contiguous 
area of the sky (Bellanger et al."1995), supplemented by CCD- 
based photometry ( Arnouts et al. 1997) and a te mplate-free 
spectral classification (Gal az & de Lapparentlll998l) . In agree- 
ment with the other existin g redsh ift surveys to smaller o r sim- 
ilar distanc es (de Lappare nt et al. 1986: Shectman et al 19961: 



ISmallet al.|[T997(: iColless et al J 120011: iZehavi et al.l l2002h . the 
ESS redshift map reveals a highly structured cell-like distri- 
bution out to z ~ 0.5 in which numerous sharp walls or fil- 
aments alternate with re gions devoid of galaxies on a ty pical 
scale of ~ 25 Mpc jBellanger & de L apparent 1995h . The 
deep pencil-beam geometry of the survey is characterized by a 
long line-of-sight of 1300 Mpc, and a transverse extent of 
~ 11 /i ' Mpc at z = 0.3, corresponding to ~ 3 correlation 
lengths (quoted scales are in comoving coordinates). The ESS 
therefore provides a sufficiently large sample for performing a 
useful two-point correlation analysis. 

Using the ESS spectral classification a nd the correspond- 
ing lu minosity functions per galaxy class dde Lapparent et af] 
I2003h . we examine the variations in the ESS clustering as a func- 
tion of galaxy type. Various surveys have detected the stronger 
clustering of early-type/re d galaxies over late-type/blue galax 
ies at redshifts z 5 0. 1 | Lovedav et al.' '1999*; 'Giuricin et al 



l200lt iNorberg etalJ 12002 

IZehavi et al.' '200 5|), and at nigner reasnitts z 

(Shepherd et al. 20011: IPhleps & Meisenheimeij|2003t ICoil et alj 
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Magliocchetti & Porciani 2003| 
at higher redshifts z ^ 0.5 



epherd et al. 2UUl:lJ^meps & MeisenheimeilKUU jt iCoil et alj 
!4t iMeneux et al.l 20061) . Further details were obtained by 



Li et al J (12006') from low redshift galaxies, whose analysis shows 



that the observed clustering differences between red and blue 
galaxies, namely a higher amplitude and steeper slope than for 
blue galaxies, are largest at small scales and for low mass galax- 
ies: the authors also measure the same clustering segregation ef- 
fects when considering galaxy age as traced by the 4000A break 
strength, instead of galaxy color To examine in further details 
the relationship between galaxy type and clustering, we propose 
here a new approach based on the separation of the giant and 
dwarf galaxies. We also measure the cross-correlation of the var- 
ious samples, which provides complementary clues on the rela- 
tive distribution of the different galaxy types. 

The paper is organized as follows. Section |2] reviews the 
characteristics of the ESS galaxy redshift survey, defines the 
sub-samples used in the present analysis, and describes the lu- 
minosity functions used for calculating the selection functions. 
In Sect. [3] we evaluate the various sources of random and sys- 
tematic errors. Results on the redshift space auto-correlation 
function ^(s) for the full ESS sample and the sub-samples by 
galaxy types are given in Sect. H] The correlation as a function 
of projected separation w{rp) for the various ESS samples are de- 
scribed in Sect.|5] along with the cross-correlation functions be- 



tween the different galaxy types. The auto and cross-correlation 
functions are then interpreted in Sect. |6] in terms of the occu- 
pation of the dark matter halos by the different galaxy types. 
In Sect. |2l we compare our results on w(rp) to those from the 
other existing redshift surveys. Finally, Sect. [8] summarizes our 
conclusions and Sect.|9]discusses them in view of other existing 
results on galaxy clustering. In the Appendix, we describe the es- 
timators which we use for calculating the two-point correlation 
functions, and we address the issues of the weighting scheme, 
the normalization of the correlation function, and the estimation 
of the mean density. 

Throughout the present analysis, we assume a flat Universe 
with, at the present epoch, a scale parameter Hq - 
lOOh km s ' Mpc a matter density Qm = 0.3 and a cosmolog- 
ical energy density Qa = 0.7 (Riess et al. 1998: Perlmutt er et al.l 
1999: Phillips et all l200ll: |Tonry et al. 2003). All absolute abso- 
lute magnitude are defined modulo +5 log/z. 



2. The ESO-Sculptor Survey 

The ESS covers a rectangular area of 0.37 deg^ defined as a 
thin strip of 1.53° x 0.24° near the south Galactic pole (bn ~ 
-83°) and centered at 0^22.5", -30.1° (2000) in the Sculptor 
constellation. The observations were performed using the New 
Technology Telescope (NTT) and the 3.6 m telescope at the 
European Southern Observatory (ESO). The photometric cat- 
alogue is based on CCD multicolor imaging in the Johnson- 
Cousins B]/^c_sxstemj_and contains nearly 13 000 galaxies to 
y ^ 24 dArnouts et aljl99"7l) . The spectroscopic survey provides 
flux-calibrated spectra and redshifts (with an rms "external" un- 
certainty cr(z) ~ 0.00055) for ~ 600 galaxies with < 20.5, 
within a slightly sma ller field of ~ 0.25 deg2=1.02° x 0.24° 
( lBellangeretalJll995h . The < 20.5 sample has a 92% red- 
shift completeness and its median redshift and effective depth 
are z - 0.3 and z ~ 0.5, respectively. Additional redshifts for 
~ 250 galaxies with 20.5 < R^ < 21.5 were also measured in the 
same are a, leading to a 52% redsh ift completeness to this fainter 
hmit (see Ide Lapparent et al.ll2003l for details). 

The ESS spectroscopic catalogue was also used to perform a 
template-free spectral classification based on a principal compo- 
nent analysis of the flux-calibrated spectra, which yields a well- 
defined sequen ce parameterized continuously using 2 indices de- 
noted 6 and 6 dGalaz & de Lapparentlll998l : Ide Lapparent et al.l 
2003): 6 measures the shape of the continuum, hence the rela- 
tive contribution from red and blue stellar populations, whereas 
the departures of 9 from the sequence measure the strength 
of the nebular emission lines, hence the current star form ation 
rate. Comparison with the Kennicutt templates CKennicuttI 1 9921) 
shows that the 6-0 sequenc e is strongly related to the Hubble 
morphological type (see also iFolkes et 311119961: iBromlev et al.l 
119981: iBaldi et alj|200lb . and provides a better estimate of the 
galaxy Hubble type than any color inform ation (as used for ex- 
ample in lLillv et alJ[T99llLin et aOl999l) . 

The ESS catalogue is also complemented by precise type- 
dependent K-corrections derived from the joint use of the spec- 
tral cla^sifi£ation_and_fli^ spectrophotometric mod- 
els dFioc & Rocca-Volmerangelll997l) . These in turn yield abso- 
lute magnitudes in t he rest-frame filter bands (Johnson-Cousins 
BVRc), from which 'de Lap parent et alj d2003h have derived de- 
tailed luminosity functions as a function of spectral type. Here, 
we make use of these various parameters and characteristics of 
the ESS survey, to measure the two-point correlation functions. 



2 



2. 1 . The galaxy samples 

The ESS spectroscopic sample was selected in magnitude, 
and is thus most complete in this band, whereas the V and B 
samples suffer color-related selection effects at faint magnitudes 
(see lde Lapparent et al.li2003 ). The present analysis is therefore 
based on the < 21.5 redshift sample, and all the quoted ab- 
solute magnitudes are in this band. In order to use only galaxies 
with a redshift value unaffected by peculiar motions within the 
local group, we omit in all samples the few ESS galaxies with 
z < 0.1. We also reject distant galaxies with z > 0.51: at these 
redshifts, the selection function becomes of the order of 10% 
and decreases steeply, which causes a very sparse sampling of 
the large-scale structures. The bounding redshifts 0.1 and 0.51 
correspond to comoving distances 

r„i„ = 284.33 /!-' Mpc 

W = 1338.04 Mpc, ^ ' 

respectively. Within these redshift boundaries, the ESS contains 
765 galaxies with a reliable redshift, which lie in the R^ absolute 
magnitude interval -23 < M + 5 log/i < -16. 

To examine the varying clustering properties of the ESS with 
galaxy type, we define various sub-samples by galaxy type and 
absolute luminosity. We first consider the 3 spectral classes de- 
fined by Ide Lapparent et all (l2003h : early-type with 6 < -5, 
intermed iate-type with -5 < ^ < 3, and late-type wit h 3 < ^. As 
shown in Ide Lapparent et"aLl (l2003h . projection of the lKennicuttI 
d 19921) templates onto the ESS classification space indicates that 
these 3 classes approximately correspond to the following mixes 
of giant morphological types: E + SO + Sa in the early class; Sb 
-I- Sc in the intermediate class; and Sc + Sd/Sm in the late class. 

Furthermore, the analysis of the ESS luminosity func- 
tions suggests that the ESS intermediate-type and late- 
type classes also contai n dwarf morphological populations 
dde Lapparent et alj l2003h : (1) gas-poor dwarf galaxies which 
are classified as intermediate spectral type due to their intermedi- 
ate color, and most likely include dwarf elliptical (dE) and dwarf 
lenticular (dSO) g alaxies, together with their nucleated analogs 
jGrant et al.l2005l) ; here, these objects are altogether denoted dE; 
(2) dwarf irregular (dl) galaxies, which are detected in the late 
spectral class due to their richer gas content, hence blue colors. 

In the hierarchical scenario of galaxy formation, variations 
in the clusteri ng properties of high mass and low m ass galaxies 
are predicted jPearce et alJl200U lYang et al.ll2004l) . which lead 
to the expectation of variations in the clustering properties of gi- 
ant and dwarf galaxies. To separate the giant and dwarf galaxy 
populations which are mixed within the intermediate-type and 
late-type ESS spectral classes, we take advantage of their respec- 
tive relative contribution at the bright and fai nt ends of the corre- 
spon ding luminos ity functions (see Fig. 1 1 in lde Lapparent et al] 
12003 or Fig. 1 of d e Lapparent et alj2004l) : we apply an R^ abso- 
lute luminosity cut at M(Rc) = -19.3 for the intermediate-type 
galaxies, and at M{Rf^) - -19.57 for the late-type galaxies. We 
then merge the bright, resp. faint, populations of both spectral 
classes, to built 2 samples which are expected to include essen- 
tially: 

- late spiral galaxies: Sb -n Sc -i- Sd/Sm; 

- dwarf galaxies: dE + dl. 

To examine the dependence of the two-point correlation 
function on the absolute luminosity, we further divide the gi- 
ant galaxy classes into "bright" and "faint" sub-samples defined 
by the median R^ absolute magnitude of the sample. Moreover, 



because the ESS exhibits a marked over-dense region in the in- 
terval 0.41 < z < 0.44 which causes a strengthening of the clus- 
tering signal (see Sect. 14.21 ). we also consider the sub-samples 
by galaxy type after removal of all galaxies in that particular red- 
shift interval. At last, for further testing the sensitivity of the cor- 
relation function to cosmic variance, we also exclude the under- 
dense region defined by 0.34 < z < 0.39 (see Sect. |4.3l l. The 
characteristics of these various sub-samples are listed in Table[T] 

2.2. The luminosity functions 

For the luminosity function ( p(M), we use the composi te lumi- 
nosity functions proposed bv Ide Lapparent et al.l (l2003h : a two- 
wing Gaussian function for t he early-type galax ies, and the sum 
of a Gaussian function and a'Schecht^ (1 19761) function for the 
intermediate-type and late-type galaxies. These composite fits 
are motivated by their better adjustment to the ESS luminos- 
ity functions than pure Schechter functions, and by their good 
agreement wit h the luminosity function s pe r galaxy type mea- 
sured locally jJerien & Tammannl l 19971; see Ide Lapparent et al.l 
2003 for details). The composite fits of the ESS luminosity func- 
tions also confirm the morphological content of the ESS spectral 
classes in terms of giant galaxies and dwarf galaxies. 

Table |2] lists the various giant and dwarf components of the 
luminosity functions for the 3 spectral classes and the corre- 
sponding parameters. The two-wing Gaussian luminosity func- 
tion for the early-type galaxies is parameterized as 

0(M) dM = cPoe-'-^"-'^^''^'^'' dM for M < Mq 
= 4>oe-^^«-^^''^'^l dM for M > Mo 

where Mq is the peak magnitude, and cr„ and cTh are the dis- 
persion values for the 2 wings. The Gaussian component of the 
intermediate-type and late-type luminosity functions is parame- 
terized as 

<^(M) dM = cpoe-''^"-'^^"'^'^" dM, (3) 

whe re Mp and cr are the peak and rms dispersion respectively. 
The ISchechte^ (Il976h component of the intermediate-type and 
late-type luminosity functions is parameterized as 

0(M) dM = 0.4 In 10 0*e-^X"+i dM 

with (4) 

^ = - iqOA(M'-M) 

where M* is the characteristic magnitude, and a + I the "faint- 
end slope". For the late spiral and dwarf sub-samples, we use 
the bright and faint parts resp. of the luminosity functions by 
spectral type (see Table[T]|. 

The parameter s liste d in Table |2] are those derived by 
'de Lapp arent et al] (1200 4') from the Rc < 21.5 sample. For the 
early-type and intermediate-type classes, the hsted values of (pp 
are those listed as il)i(0.51) in Table 2 of Ide Lapparent et al.l 
(2004) . derived using an "equal pair" weighting for the mean 
density estimator (see Eqs. IF. 11 and ID. It ; they thus yield a total 
expected number of galaxies over the redshift interval 0. 1 - 0.5 1 
for a homogeneous distribution which is equal to the observed 
number of galaxies in each spectral class. For the late-type class, 
we use (and list he re in Table O the paramete rization <i>\iz) pro- 
vided in Table 2 of lde Lapparent etal] (|2004|) . which reflects the 
marked evolution of the amplitudes 0o and (p* for the ESS late- 
type galaxies. This evolution could also be due to pure luminos- 
ity evolution, but the availa ble data do not aUow us to discrimi- 
nate between the 2 effects (ide Lapparent et af]|2004l) . Whatever 
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Table 1. Definition of the ESO-Sculptor survey sub-samples used for calculation of the two-point correlation function. 



Sub-sample 


Redshift range 


Ri: absolute magnitude range 


Spectral range 




<S> 


(1) 


(2) 


(3) 




(4) 






(5) 


(6) 


all galaxies: 








< 




< 








- with the over-density 


]0.1;0.51] 


-23.0 < M - 51og/i < -16.0 


-20 


< 


S 


< 


20 


765 


-0.53 


- without the over-density 


]0.1;0.51] - [0.41;0.44] 


-23.0 < M - 51og/7 < -16.0 


-20 


< 


6 


< 


20 


654 


-0.09 


- without the under-density 


]0.1;0.51] - [0.34;0.39] 


-23.0 <M-5\ogh < -16.0 


-20 


< 


6 


< 


20 


709 


-0.44 


early-type: 








< 




< 








- with the over-density 


]0.1;0.51] 


-23.0 < M - 51og/i < -16.0 


-20 


< 


6 


< 


-5 


274 


-8.46 


• bright early-type 


]0.1;0.51] 


-23.0 <M-5logh< -21.14 


-20 


< 


6 


< 


-5 


137 


-8.63 


• faint early-type 


]0.1;0.51] 


-21.14 < M-51og/7 < -16.0 


-20 


< 


6 


< 


-5 


137 


-8.29 


- without the over-density 


]0.1;0.51] - [0.41;0.44] 


-23.0 <M-51og/i< -16.0 


-20 


< 


6 


< 


-5 


218 


-8.43 


• bright early-type 


]0.1;0.51] - [0.41; 0.44] 


-23.0 <M-51og/!< -21.14 


-20 


< 


6 


< 


-5 


97 


-8.45 


• faint early-type 


]0.1;0.51]-[0.41;0.44] 


-21.14 <M- Slog/; < -16.0 


-20 


< 


6 


< 


-5 


121 


-8.41 


- without the under-density 


]0.1;0.51]- [0.34; 0.39] 


-23.0 < M - 51og/i < -16.0 


-20 


< 


6 


< 


-5 


245 


-8.45 


intermediate-type: 








< 




< 








- with the over-density 


]0.1;0.51] 


-23.0 < M - 51og/i < -16.0 


-5 


< 


6 


< 


3 


240 


-1.04 


• bright intermediate-type 


]0.1;0.51] 


-23.0 < M - 51og/i < -19.30 


-5 


< 


6 


< 


3 


207 


-1.15 


- without the over-density 


]0.1;0.51] - [0.41;0.44] 


-23.0 < M - 5 log h<- 16.0 


-5 


< 


6 


< 


3 


206 


-1.03 


• bright intermediate-type 


]0.1;0.51] - [0.41; 0.44] 


-23.0 < M - 5 log/! < -19.30 


-5 


< 


6 


< 


3 


173 


-1.16 


- without the under-density 


]0.1;0.51]- [0.34; 0.39] 


-23.0 < M - 51og/i < -16.0 


-5 


< 


6 


< 


3 


231 


-1.02 


late-type: 








< 




< 








- with the over-density 


]0.1;0.51] 


-23.0 < M - 5 log /z < - 19.30/ - 19.57 


3 


< 


S 


< 


20 


251 


+8.61 


• bright late-type 


]0.1;0.51] 


-23.0 < M - 51og/! < -19.57 


3 


< 


6 


< 


20 


125 


+7.53 


- without the over-density 


]0.1;0.51] - [0.41;0.44] 


-23.0 < M - 51og/! < -16.0 


3 


< 


6 


< 


20 


230 


+8.66 


• bright late-type 


]0.1;0.51] - [0.41; 0.44] 


-23.0 < M - 5\ogh < -19.57 


3 


< 


6 


< 


20 


106 


+7.53 


- without the under-density 


]0.1;0.51]- [0.34;0.39] 


-23.0 < M - 51og/i < -16.0 


3 


< 


6 


< 


20 


233 


+8.55 


late spiral galaxies: 








< 




< 








- with the over-density 


]0.1;0.51] 


-23.0 < M - 5 log /!< - 19.30/ - 19.57 


-5 


< 


6 


< 


20 


332 


+2.11 


• bright late spiral 


]0.1;0.51] 


-23.0 < M - 5 log /2 < -20.56 


-5 


< 


6 


< 


20 


166 


+0.65 


• faint late spiral 


]0.1;0.51] 


-20.56 <M-5logh< -19.30/ - 19.57 


-5 


< 


6 


< 


20 


166 


+3.59 


- without the over-density 


]0.1;0.51] - [0.41;0.44] 


-23.0 < M - 51og/z < -19.30/ - 19.57 


-5 


< 


6 


< 


20 


279 


+2.14 


• bright late spiral 


]0.1;0.51] - [0.41;0.44] 


-23.0 <M-5logh< -20.56 


-5 


< 


6 


< 


20 


127 


+0.65 


• faint late spiral 


]0.1;0.51] - [0.41;0.44] 


-20.56 < M-51og/j < -19.30/ - 19.57 


-5 


< 


6 


< 


20 


152 


+3.39 


dwarf galaxies: 








< 




< 








- with the over-density 


]0.1;0.51] 


- 19.30/ - 19.57 < M - 5 log /!< - 16.0 


-5 


< 


S 


< 


20 


159 


+7.59 


• faint intermediate-type 


]0.1;0.51] 


-19.30 <M-51og/i< -16.0 


-5 


< 


6 


< 


3 


33 


-0.37 


• faint late-type 


]0.1;0.51] 


-19.57 <M-51og/i< -16.0 


3 


< 


6 


< 


20 


126 


+9.68 



Definition of columns: 

(1) identification of the sub-sample; (2) redshift interval; (3) interval of absolute magnitude; (4) interval of spectral index d; (5) number of 
galaxies in the sub-sample; (6) average spectral type 6 for the sub-sample. 



the nature of this evolution, the parameterized amplitude evo- 
lution listed in Table |2] does allow us to estimate the selection 
function (Sect.O required for calculating correlation functions. 

For the intermediate-type and late-type class, the values of 
(f>* are derived from the values of 0o using the ratios 



0.4 In 10, 
0.4 In 10, 



0.83 for intermediate - type 
0.10 for late -type 



(5) 
(6) 



also provided bv lde Lapparent et aTl (|2004 see their Table 1). 

These various luminosity functions allow us to derive the 
corresponding selection functions affecting the ESS sub-samples 
(see Sect. |C]l- These yield the expected redshift distribution for 
homogeneous samples, which are shown in Figs.[T]and|2]and are 
compared with the ESS observed distributions for each spectral 
class and galaxy type. To calculate the expected redshift distribu- 
tion, we also use fo r each sub-sample the /T-c orrection function 
K(z, 6) provided bv lde Lapparent et al.l ( |2004|) at the mean value 
of the spectral-type 6 listed in the Table [1] Note that compari- 



son of the observed and expected distributions for the 3 spectral 
classes shown in Fig. [T] confirms the validity of the luminosity 
functions and amplitudes listed in Table |2] and in particular val- 
idates the parameterization of the amplitude evolution for the 
late-type galaxies. 



3. Computing the correlation function and its 
uncertainties 

The formalism for derivation of the comoving distances r from 
the redshifts, for calculating the three different estimators of the 
redshift-space and projected correlation function (Davis-Peebles 
DP, Landy-Szalay LS, and Hamilton H), the various selection 
functions and the corresponding three weighting schemes (J3, 
"equal volume" EV, and "equal pair" EP), the normalization, 
and the mean density are defined in the Appendix. Because the 
variance in the estimates of ^(s) depends on the chosen statis- 
tical weights, it is useful to apply the three weighting schemes 
to each of the 3 estimators of the correlation function, and to 
cross-check the results; this is done in the Sect.|4] Here, as a pre- 
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Table 2. Parameters of the Gaussian and Schechter components of the composite luminosity functions fitted to the ESO-Sculptor 
spectral classes atR^ < 21.5. 



Luminosity function parameters 


early-type 


intermediate-type 


late -type 




Gaussian component: 










Morphol. content 


E + SO + Sa 


Sb + Sc 


Sc + Sd/Sm 




Mo - 5 log h 


-20.87 ± 0.23 


-20.27 ± 0.21 


-19.16 ±0.29 




cr 


0.84 ±0.24/ 1.37 ±0.36 


0.91 ±0.18 


0.97 ±0.13 




00 


0.00333 


0.00326 


0.00194[1 +3.51 (z- 


0.15)] 


Schechter component: 










Morphol. content 




dE 


dl 




M* - 5 log h 




-19.28 ±0.37 


-18.12 ±0.22 




a 




-1.53 ±0.33 


-0.30 








0.00426 


0.02106[1 -h3.51(z- 


0.15)] 



Notes: 

- For the early-type luminosity function, the 2 listed values of tr are cr„ / cti, (see Eq.[2j. 

- The amplitudes 0o and 0* are in units of h^ Mpc"'' mag"' . 



liminary, we describe and estimate the various uncertainties at 
play in the correlation function measurements. 

3.1. Statistical noise in ^(s) 

From the experimental point of view, statistical error bars in f (s) 
would be best determined from the ensemble error by splitting 
the survey into independent regions containing approximately 
equal numbers of galaxies and taking the standard deviation of 
the correlation function estimates calculated in these sub-areas. 
Unfortunately, the size of the ESS redshift sample is too small to 
allow for such an approach. Here we consider both the Poisson 
error 

crp,,s.(s)^[l+^(s)]DD(sr''^; (7) 

and the bootstrap error crboot('?), which is derived as the stan- 
dard deviation in the estimates ^(i) from 50 randomly data sets of 
A^d points obtained from the original A^d galaxies by re-sampling 
with re placement, witho ut any correction for possible systematic 
biases (iLing et aLlll986 ). The Poisson error is an underestimate 
of the true uncertainty for correlated data but is appropriate in the 
regime of weak clustering, i.e. at large scales {s S 10 /;"' Mpc). 
In contrast, the bootstrap error tends to overestimate the true er- 
ror in over-dense r egions by roughly a factor two, as shown by 
iFisher et"an (11994}) . In the following, we thus adopt the boot- 
strap error at all scales s as the statistical random uncertainty in 
the measured values of ^(s) and ^(rp, n). 

3.2. Uncertainties from distances 

A priori, derivation of distances for the ESS galaxies requires 
to corre ct the ESS velocities for the motion within the L ocal 
Group ( Yahil et al .''1977'; Courteau & van den Bergh'1999^, the 
infall onto Virgo (Ramella et al. 1997; Ekholm et al. 2001), and 
the cosmic microwave background dipole dSmoot et al.lll99ll) . 
We estimate the impact of these velocity corrections by calculat- 
ing the difference in correction value for 4 imaginary points lo- 
cated at the extreme 4 "corners" or the ESS survey region. Each 
"corner" point is defined by the constant value of either one of 
the 2 coordinates RA (J2000), Dec (J2000) among 

RA™i„ = OHg.O'" RA„ax = 0*'23.5™ 
Decniin = -30° 14' Decmax = -29°58', 



while the other coordinate takes the 2 possible values. The 
largest resulting velocity differences are 2.5 km s"' for pairs of 
points in which only RA varies; 1.4 km s ' for pairs of points 
in which only Dec varies. The largest velocity difference of 
3.7 km s ' is obtained for the pair of points with coordinates 
(RAmin,DeCmax) and (RAmax,DeCniin)- Thcsc values are neglige- 
able compared to the ESS rms uncertainty in the velocities of 
cr(v) ~ 165 km s"'. We thus neglect the effects of the 3 men- 
tioned systematic motions in the estimation of distances. 

The uncertainties in the ESS redshifts icr{z) ~ 0.00055) is 
also a source of random error in the measurement of the correla- 
tion function. To estimate its impact, we add to all galaxies in the 
ESS early-type sub-sample an additional dispersion in the red- 
shift dz defined by a Gaussian probability distribution centered 
at zero and with an rms deviation cr(z) ~ 0.00055. We repeat this 
procedure 30 times, and measure an rms dispersion in ^ls{-^) at 
scales 1 < i < 15 /i"' Mpc which is 2 to 3 times smaller than 
the bootstrap uncertainty. Similar results are obtained using the 
intermediate-type and late-type sub-samples. We thus neglect 
this additional source of random error. 

3.3. Uncertainties from the luminosity function 

As far as systematic errors are concerned, a dominant contri- 
bution to the correlation function may be the uncertainty in the 
selection function (Sect. |C]l, which results from the uncertain- 
ties in the luminosity function. As shown by Peebles ( 1980), the 
quadratic H estimator (Eq. |B.6l l is more affected than the DP and 
LS estimators (Eqs. IB. 51 and |B.7t see Sect. |B]). For power-law 
correlation functions (Eq. ID.4l i. such biases have more impact 
on the correlation length sq than on the power-law index y. As 
described in Sect. |2.2| and Table |2] five luminosity functions are 
involved in the computation according to the considered spectral 
class. In principle, any derivation of sq and y should be repeated 
by varying the selection function parameters along the six prin- 
cipal axes of its error ellipsoid, and the scatter among the results 
added in quadrature to their statistical uncertainties. In practise, 
we change the value of Mq for the early-type and intermediate- 
type luminosity functions, and the value of the Schechter slope 
a for the intermediate-type and late-type luminosity functions 
by plus or minus their rms uncertainty (listed in Table |2]i. The 
resulting systematic shifts in ^ls{-^) for 1 < i < 5 /i"' Mpc 
are +4.2% and ±8.6% when changing Mq for the early-type 
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redshift 



Fig. 1. Redshift histograms for the early-type (top panel), 
intermediate-type (middle panel), and late-type (bottom panel) 
spectral classes of the ESO-Sculptor survey, using a redshift bin 
of 0.02. The solid curves show the expected distributions for a 
homogeneous sample given the luminosity functions defined in 
Table |2] the magnitude limits and the angular coverage of the 
survey. 



and intermediate-type samples resp.; and ^^3 5* and 53°* when 
changing a for the intermediate-type and late-type samples re- 
spectively; these various shifts are ~ 4 to 10 times smaller than 
the bootstrap errors for each sample. 



3.4. Uncertainties from tirte Ji weigiiting 

Another source of uncertainty is the choice of the parameteriza- 
tion for J3{s) in the case of a ^3 weighting scheme (see Eq. |D.3t . 
We estimate this uncertainty by comparing ^ls('?) for the ESS 
early-type sub-sample with that using the following weight- 
ing parameterization 

(9) 



J3(s) = 14.98 i' "* h-^ Mpc" 
73(5) = 1752 h-^ Mpc^ 



for 
for 



S < Sc, 
S > Sc. 



(with S(, = 30 /i ' Mpc). This other parameterization of Jjis) is 
obtained from the power-law description of the correlation func- 
tion (Eg. ID. 4b with a 10% increase of so above the value given 




Fig. 2. Redshift histograms for the late spiral (top panel) and 
dwarf (bottom panel) sub-samples of the ESO-Sculptor survey 
(see Fig.[T]for details). 



in Eg. ID. 51 The relative change in ^ls('S) is then 1.1 % at all 
scales, which is one to two orders of magnitude smaller than 
the bootstrap random uncertainties. Performing a similar test in 
which only the slope y of the power-law parameterization is in- 
creased by 10% over the value in Eg. ID.5l vields slightly larger 
variations in ^(s) (< 2.2 %). Decreasing either io or y by simi- 
lar amounts yields the corresponding opposite shifts in ^(s). The 
systematic uncertainties in Jj,{s) therefore have a very small im- 
pact on the error budget in ^(s). 

3.5. Cosmic bias 

The correlation function is also affected by a systematic bias 
called "cosmic bias", which is caused by using the observed 
density of galaxies in the sample for normalization of the num- 
ber of pairs (see Sect. |E]l. This results in an impUcit normal- 
ization to zero of the integral of the correlation function over 
the survey volume. However, in finite samples, the two-point 
correlation function is positive out to scales of ~ 20 Mpc, 
and the mean density of galaxies estimated from a sample of 
comparable scale is an over-estimate of the mean density of the 
Universe. The corresponding bias in the correlation function is 
then expected to be negative. In that case, the cosmic bias can 
be corre cted for by an additive correction, called " integral con- 
straint" (Ratcliffe et all! 19961: iBrainerd et"anil995l) . In contrast, 
for sample sizes of ~ 100 /z"' Mpc or larger, the presence of an 
under-density occupying a large volume may instead lead to an 
under-estimation of the mean density and a corresponding over- 
estimation of the correlation function. 

To estimate the cosmic bias for the ESS, we vary by +4% 
(which corresponds to y/N/N - 0.036, where = 765 is 
the number of galaxies in the full ESS sample, see Table [T]) 
the amplitude 0o of the Gaussian component of the early-type. 
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intermediate-type and late-type luminosity functions, and the 
amplitude <p* of the Schechter components of the intermediate- 
type and late-type luminosity functions (see Table|2]i, and calcu- 
late the resulting ^{s) for the full ESS sample. The shift in ^{s) 
for the full ESS sample is ^ 4% for 1 < i < 9 h'^ Mpc, which is 
10 times smaller than the bootstrap error; the shift then increases 
at larger scales, taking its largest value at s ^ 14 - 28 /i"' Mpc, 
as it is comparable to the transverse extent of the survey. 

Nevertheless, we show in Sect. I4.2l that a marked over-dense 
region of the ESS causes a larger systematic shift in the corre- 
lation function than the above estimated cosmic bias, and fur- 
thermore, this shift is in the opposite direction (an excess cor- 
relation). We thus choose to neglect the standard "cosmic bias", 
and instead, we evaluate the impact of this over-density onto the 
various measured correlation functions in Sects. 143114.2114.3115. II 
and |5.3l In Sect. 15.21 we further discuss the role of this structure 
in terms of cosmic variance. 

4. The redshift-space correlation function ^{s) 
4. 1. General behavior of^{s) 

Top panel of Fig.|3]shows the 9 combinations of the 3 estimators 
H, LS and DP (see Sect.|B]i and the 3 weighting schemes J3, EV 
and EP (see Sect. iDj applied to the full ESS sample limited to 
Rc < 21.5, -23 < M(R^) - 51og/i < -16 and 0.10 < z < 0.51 
(765 objects, see Table [T]!. Comparison of the various estima- 
tors confirms that the 73 weighting behaves as the EP weighting 
at small separation s, and as the EV weighting at large s. For a 
given weighting scheme and at scales s ^ 0.2 /i"' Mpc, the dif- 
ferences between the 3 estimators are significantly smaller than 
the error bars in each estimate. The bootstrap errors for the LS 
estimate of ^{s) are shown in Fig. 21 the bootstrap errors in the 
DP and H estimates are comparable to those in the LS estimate, 
but have a less stable behavior with varying separation. For this 
reason, and because the 73 weighting is the minimum variance 
weighting and does not favor nearby nor distant pairs, we only 
show and examine in the following the LS estimate of ^{s) with 
73 weighting; note, however, that the results and conclusions of 
the article are unchanged using the other estimators and weight- 
ing schemes. 

The various pairs of objects in top panel of Fig.[3]are counted 
in logarithmic bins of equal size with A log s = 0. 1 . In the fol- 
lowing, we adopt this bin size, as it allows one to probe the small 
scale regime s ^ 1 h^^ Mpc. Note that even if ^(s) for the ESS is 
biased on these scales, w(rp) can successfully be measured down 
to s ^ 0.2 /i ' Mpc (see Sect. |5]l. We show in bottom panel of 
Fig. |3]that the overall behavior of ^(s) for the ESS is kept un- 
changed when shifting the bin set by half the bin size, or when 
using larger bin sizes with Alog s = 0.15 and Alog s = 0.2; sim- 
ilar conclusions are drawn for the correlation functions ^(rp,7r) 
and w(rp) considered in the following sections. 

In Fig.m we show the LS estimate of ^(s) with 73 weighting 
from the full ESS sample (labeled as "0.10 < z < 0.51"), along 
with its bootstrap errors; in top panel, ^(s) is in logarithmic scale, 
and in bottom panel, in linear scale. The redshift-space correla- 
tion function has the usual power-law behavior at small scales, 
and a smooth roll-off at 5 ^ 10 h^^ Mpc. The adjustment of a 
power-law (see Eg. |D.4t in the interval 0.5 < s < 5.0 /z ' Mpc 
yields a correlation length and correlation slope of 

=7.49 + 3.18 /j^'Mpc, 7 = 0.90 ±0.13, (10) 

resp.; this power-law fit is shown as a solid line in both panels of 

Fig. a 
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Fig. 3. The redshift-space correlation function ^{s) for all ESO- 
Sculptor galaxies with 0.10 < z < 0.51. The top panel dis- 
plays the result obtained with a bin size of Alog(5) = 0.10 for 
the 3 estimators Landy-Szalay (filled symbols), Hamilton (open 
symbols), Davis-Peebles (starred symbols), and the 3 weight- 
ing schemes J3 (magenta circles and diagonal stars), "equal vol- 
ume" (denoted EV, green squares and stars) and "equal pair" 
(denoted EP, cyan triangles and cross). The bottom panel com- 
pares the Landy-Szalay estimate of ^{s) with a 73-weighting for 
different values of the bin size: Alog(i) = 0.10 (magenta cir- 
cles), Alog(.s) - 0.15 (green triangles), Alog(s) = 0.20 (cyan 
squares); the bin size Alog(s) = 0.10 with a 0.05 shiftin Alog(i) 
from the origin is also plotted (black asterisks). For sake of clar- 
ity, only two sets of points are connected by a sohd line. 



Top panel of Fig. |4] shows that at larger scales, s ~ 
10 Mpc, ^(s) breaks down from the power-law fit. Then 
at s - 15 Mpc, the amplitude of the correlation function 
crosses zero, as seen in bottom panel of Fig. H] ^{s) rises up 
again at scales 25 ^ s ^ 40 Mpc, and another peak occurs at 
50 < < 60 /z ' Mpc. This large-scale behavior is discussed in 
the next sub-sections. 

4.2. Impact of the over-density at 0.41 < z < 0.44 

Part of the deviations of ^(s) from null clustering at 5 ^ 
10 /i ' Mpc (seen in bottom panel of Fig. [Hi appear to be due 
to the presence of a marked over-density in the redshift interval 
0.41 < z < 0.44. This structure is clearly seen in the redshift- 
cones of the survey shown in Fig.|5] It also appears in the redshift 
histograms shown in Fig. [T] as an integrated excess by nearly a 



ESO- 



Sculptor 



Survey 




right ascension 



Fig. 5. Redshift cone-diagrams for the ESO-Sculptor survey, truncated into 3 redshift intervals (3 left cones). A total number of 
769 galaxies with R < 21.5 and reliable redshift in the interval 0.1 < z < 0.51 are plotted in the full cone (to the right), which is 
stretched in angle by a factor 3. Dwarf galaxies (blue crosses) are plotted first, then the late spiral galaxies (green triangles), and 
finally the early-type galaxies (red disks). These graphs show that the survey intercepts many large-scale structures, appearing as an 
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Fig. 4. The redshift-space correlation function ^(s) for the ESO- 
Sculptor galaxies, computed with the Landy-Szalay estimator 
using the minimum-variance /s-weighting scheme for (i) all 
galaxies with 0.10 < z < 0.51 (black filled circles); (ii) the sub- 
sample in which the over-density in the interval 0.41 < z < 0.44 
is removed (green open circles); (iii) the sub-sample in which 
the under-dense region in the interval 0.34 < z < 0.39 is re- 
moved (cyan triangles). The bottom panel shows the same curves 
in linear scale, restricted to > 3 /; ' Mpc. Both panels display 
^{s) with a bin size Alog(.s-) = 0.10, and show the power-law 
model fitted to the full sample with 0.10 < z < 0.51 in the 
interval 0.5 < s < 5.0 /i ' Mpc (black solid line). The boot- 
strap error bars for the sub-sample without the under-density at 
0.34 < z < 0.39 are not shown, as they are similar to those for 
the full sample. 

factor 2 over the expected number for a homogeneous distribu- 
tion (indicated by the solid lines) for the early-type and late-type 
galaxies. 

The ESS over-dense region at 0.41 < z < 0.44 has an impact 
on the redshift-space correlation function at both intermediate 
and large scales. Top panel of Fig.|4]shows that when removing 
the over-density, ^(s) shifts to lower amplitudes in the interval 
0.5 < i < 5 /z ' Mpc, which results in a lower amplitude and 
steeper slope for the power-law fit: 

so =4.22+ 1.15 /z^'Mpc, y= 1.22 + 0.15, (11) 

(measured for 0.5 < 5 < 5 /z"' Mpc). If the change in ^(s) was 
solely due to the change in the normalizing density, a higher am- 



plitude of ^(s) would be expected when removing the galaxies 
in the 0.41 < z < 0.44 interval, as this over-dense region tends 
to artificially increase the mean density of the sample, thus con- 
tributing to the cosmic bias (see Sect. 13. 5t . The decreasing am- 
plitude of ^(s) at i ^ 2 /i"' Mpc implies that galaxies in the 
0.41 < z < 0.44 region have stronger clustering at medium and 
large scale than the average for the rest of the survey. Indeed, de- 
tailed examination of Fig. [^indicates that the large-scale struc- 
ture at 0.41 < z < 0.44 is a dense collection of groups of galaxies 
extending over Az ~ 0.025, that is ~ 60 /i"' Mpc in comoving 
distance. In Sect. 14.41 below, we show that both the early-type 
and late spiral galaxies contribute to the excess clustering in this 
region. 

When the galaxies in the redshift interval 0.41 < z < 0.44 
are removed from the ESS full sample, the deviations of ^(s) 
from zero at scales 9 ^ s $ 150 /i"' Mpc (see bottom panel of 
Fig.HJl are reduced to less than the bootstrap uncertainty for most 
points. In particular, the second peak at 50 < i < 60 /i ' Mpc 
becomes insignificant. The peak at 25 :^ i ^ 40 /i"' Mpc is also 
significantly reduced to a "marginal" detection, as ^(s) deviates 
by less than twice the bootstrap error for s ^ 35 h^^ Mpc. One 
possible interpretation of the shift towards negative values of 
^(s) at 5 ~ 90 Mpc, when removing the over-density within 
0.41 < z < 0.44, could be the artificial anti-correlation thus cre- 
ated between this empty region and the foreground/background 
walls of galaxies: the difference in comoving distance between 
z = 0.41 and z = 0.44 is ^ 72 h'^ Mpc. 

When removing a given redshift interval from an ESS sam- 
ple, the selection function of each of the 3 spectral-type samples 
is assigned to zero in that interval, and no points are generated 
in that redshift interval of the random distributions. To check 
that the procedure does not introduces any bias, we also calcu- 
late ^(i) for the full ESS sample with all galaxies in the red- 
shift interval 0.34 < z < 0.39 removed: this region of the ESS 
has a similar volume as the region defined by 0.41 < z < 0.44, 
and corresponds to an under-dense region in the ESS early-type 
and intermediate-type redshift histograms (Fig.lTJ. The resulting 
^(s) with the 0.34 < z < 0.39 interval removed is over-plotted 
in both panels of Fig. H) and compared to that for the full ESS 
sample: it shows negligeable changes at all scales. Although the 
0.34 < z < 0.39 region is under-dense compared to the rest of 
the ESS, it has little impact on the two-point correlation function 
at all scales. 

4.3. Large-scale power in ^(s) 

The excess in ^(s) at 25 ^ s ^ 40 h^^ Mpc, seen in 
bottom panel of Fig. |4] might also be due in part to the 
pencil-beam geometry of the ESS. The large-scale clustering 
of galaxies is ch aracterized by walls and filaments which delin- 
eate large voids (de Lapparent et al."1986';'Shectman et al.l ll996t 
Small et al. 1997; Colless et al. 2001; Zehavi et al. 2002). This 
results in an alternation of voids and narrow portions of walls 
or filaments intercepted at a wide range of angles with the line- 
of-sight of the survey, as one then expects few walls, and even 
fewer filaments, to be intercepted parallel to the line-of-sight, 
and thus to appear as an extended over-density along the line-of- 
sight (the over-density at 0.41 < z < 0.44 may however be one 
of these rare occurrences). Then, the particular line-of-sight and 
limited volume sampled by the ESS may define a typical scale 
for the wall/filament separation, which would appear as excess 
signal in the two-point correlation. 

A pair separation analysis provides quantitative evidence for 
the impact of the ESS pencil-beam geometry onto the detected 
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Fig. 6. Pairs separations and the redshift-space correlation func- 
tion ^(i) at large scales. The top panel shows the histogram of the 
data pair separations for all ESO-Sculptor galaxies with 0.10 < 
z < 0.5 1 . The number of pairs decreases as the separation in co- 
moving distance increases, as expected in a pencil-beam survey. 
Superimposed on the overall trend, numerous peaks are visible 
and define an apparently regular pattern. The periodogram of 
the detrended signal is given in the bottom panel. A period of 
33.9 Mpc (v - 0.0295) is evidenced. Also present are at 
least four other smaller peaks linked to components with 26.4 
and 23.3 /i ' Mpc periods and the related multiples. 



0.10 < z < 0.51 




Fig. 7. The redshift-space correlation function ^(s) for the ESO- 
Sculptor sub-samples restricted to the 3 galaxy types: early-type 
(red circles), late spiral (green diamonds), and dwarf galaxies 
(cyan open stars). The top panel displays ^(s) for all samples 
with 0.10 < z < 0.51 while the bottom panel shows the results 
for the samples in which galaxies within the over-density 0.41 < 
z < 0.44 have been excluded. The same correlation function for 
the dwarf galaxies (cyan open stars) is shown in both panels as 
this sample contains no galaxies with z > 0.41 (see Fig. |2]i. In 
each panel, the continuous line indicates the power-law fit to ^(s) 
for the full sample (see Fig. ID and Eqs. [TOlfTTT i. For clarity, in 
both panels, the one-sigma error bars are only plotted for every 
other point of the late spiral and dwarf galaxies. 



large-scale clustering. Top panel of Fig.|6]shows the histogram of 
the galaxy pair separations in comoving distance for the ESS full 
sample. This distribution exhibits numerous peaks which seem 
to define a preferred scale. The bottom panel of Fig. |6] shows 
the "periodogram" obtained by a spectral density analysis of the 
pair separation distribution from which the continuum has been 
subtracted. A marked peak occurs at 34 Mpc (v = 0.0295), 
which indicates an increased probability of having pairs of ESS 
galaxies separated by this scale. This in turn explains the excess 
signal in ^(s) at 25 ^ s ^ 40 /i"' Mpc (bottom panel of Fig.|4|. 
Note that this scale corresponds to the mean interval picked up 
by the eye between adjacent walls/filaments in the cone diagram 
of the ESS (Fig. [S]): 34 /i^' Mpc corresponds to Az = 0.013 at 
z = 0.3, that is 30% larger than the tick mark separation. When 
the over-dense region with 0.41 < z < 0.44 is removed from the 
ESS, the results of the pair separation analysis remain; the peak 
at 34 Mpc in the periodogram becomes however weaker. 



which confirms that the over-dense region also contributes ex- 
cess pairs in ^(s) at 25 ^ s ^ 40 Mpc. 

We emphasize that the result shown in Fig. |6]is not inter- 
preted as evidence f or periodicity in the galaxy distribution (see 
lYoshida et"aLll200l b. It is symptomatic of the fact that the ESS 
does not represent a fair sample of the galaxy distribution, due 
to its limited volume: as a result, the alternation of voids and 
walls/filaments along the line-of-sight, and the presence of one 
over-density parallel to the line-of-sight, both leave an imprint 
in the correlation function. 



4.4. ^(s) per galaxy type 

Top panel of Fig. |2]shows ^(s) for the early-type, late spiral and 
dwarf galaxies (see Table[T]for details on each sub-sample). For 
comparison, the power-law fit to ^(s) for the full sample is also 
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plotted. This comparison shows that the correlation functions for 
the early-type, fitted by 

i() = 7.67 + 4.08 /j^'Mpc, 7= 1.06 ±0.18 (12) 

(measured for 0.7 < s < 7.5 Mpc), has a similar power-law 
behavior as for the full sample (see Eq.fTOland Fig.O. The late 
spiral galaxies present a lower amplitude, and flatter slope of ^(5) 
at small scales than for the early-type galaxies: the power-law fit 
is defined by 

=4.90 + 2.55 /!"'Mpc, 7 = 0.96 ±0.18 (13) 

(measured for 0.7 < .? < 9.0 /i ' Mpc). In contrast, the dwarf 
galaxies show evidence for a lower clustering amplitude, by a 
factor ~ 3.5, and a steeper slope than for the earlier galaxy types: 

= 1.94 ±0.81 Mpc, 7 = 2.18 ±0.71 (14) 

(for 0.7 < .? < 4.0 /i"' Mpc). The marked cut-off in ^{s) around 
i = 14 Mpc and the excess power at i ~ 30 /i"' Mpc, vis- 
ible for the 3 spectral classes is symptomatic of the geometry 
and limited volume of the ESS survey, already discussed in the 
previous sub-section. 

We emphasize that the different clustering for the late spiral 
and dwarf galaxies in Fig. [T] strongly supports the fact that both 
galaxy types are physically relevant classes for distinguishing 
the different components of the galaxy density field. Note also 
that in Fig.|2]and in most of the following graphs, the mentioned 
clustering differences among the various sub-samples are often 
significant at the 2cr level at most, due to the limited size of the 
ESS. We however take them at face value and derive an interpre- 
tation in terms of type segregation in the two-point clustering. 

The clustering differences among the ESS galaxy types con- 
firm the visual impression from the ESS redshift cone (Fig. |5]): 
the early-type galaxies are concentrated within the densest re- 
gions, corresponding to groups of galaxies, whereas the late 
spiral and dwarf galaxies also populate the sparser regions of 
the density field. The observed behavior of the ^(s) for the 3 
ESS galaxy types is related to the type-density relation, orig- 
inally named "morpho logy-density" relation (Dressier 1980; 
iPostman & Gelleill984l) . The elliptical galaxies tend to populate 
the densest regions of the Universe, namely clusters and groups 
of galaxies, and thus tend to have a stronger two-point corre- 
lation function on scales of a few /i ' Mpc, corresponding to 
the extent of these concentrations. The late-type spiral galaxies 
are much more weakly clustered and populate the lowest density 
regions, whereas the early spiral galaxies have an intermediate 
behavior 

Recently, using the Sloan Digital Sky Survev. Blant on et alj 

( 12005) showed that it is the present star formation rate which is 
directly related to the local density, and the correlation with the 
morphology is a consequence of the relationship between the 
present star formation rate of a galaxy and its morphology. The 
ESS spectral classification has the advantage to be tightly relate d 
to the present star formation rate dGalaz & de Lapparentll 19981) . 
and the observed trends of ^{s) seen in Fig. [T] are in agreement 
with the earlier-type galaxies residing in higher density environ- 
ments than the late spiral galaxies. 

The correlation function for the dwarf galaxies points to a 
more subtle effect, which is detected here for the first time. At the 
smallest scales, the amplitude is as high as that for the early-type 
galaxies, and it steadily decreases at larger and larger scales: at 
0.9 < 5 < 1.3 /i"' Mpc, ^(s) for the dwarf galaxies is comparable 
to that for the late spiral galaxies, and it becomes a factor of 
~ 2 - 10 times lower at 1.3 < < 4.0 /i"' Mpc. This is consistent 



with the dwarf galaxies populating the dense groups (small scale 
behavior of i;(s)), whereas on scales of 2-4 Mpc, they appear 
much more weakly clustered than both types of giant galaxies 
(early-type and late spiral). 

Bottom panel of Fig. |7] shows ^(5) for the ESS early-type 
and late spiral galaxies when excluding all galaxies with 0.41 < 
z < 0.44. For the dwarf galaxies, we plot the same curve as in 
Fig.[TO]as this sample contains only 2 galaxies with z > 0.41 (see 
Fig.|2|. The power-law fit to ^(5) for the full sample without the 
over-density is also plotted (Eq.fTTI). A power-law model is still 
a good fit to both functions. For the early-type class, we measure 

=4.79 ± 1.69 /j-'Mpc, 7= 1.47 ±0.20 (15) 

in the interval 0.7 < s < 7.5 /z ' Mpc. For the late spiral galaxies, 
we obtain 

.?() = 3.81 ±2.41 /r'Mpc, 7 = 0.96 ±0.25 (16) 

(for 0.7 < s < 9.0 /! ' Mpc). Therefore, the effect of removing 
the over-density onto the correlation functions for the early-type 
and late spiral galaxies is a decrease in amplitude at scales s ^ 
3 /i ' Mpc: a lower amplitude sq for both types, and a steeper 
slope for the early-type galaxies. The fact that ^{s) for both the 
early-type and late spiral galaxies are affected by removing the 
over-density indicates that these two populations contribute to 
the excess clustering in this region. 

The differences in the spatial correlation function between 
different galaxy types may actually be larger than those seen in 
^(s), because of the redshift distortions caused by the galaxy pe- 
culiar velocities (see Sects. |G]l, which tend to erase the type ef- 
fects. At small scales (i ~ 1 Mpc), the redshift distortions 
caused by the random motions in dense regions tend to weaken 
the amplitude increase of ^(s) for the early-type galaxies with 
respect to the other types; although there are no rich clusters 
of galaxies in the ESS, the survey contains contains numerous 
groups of galaxies (seen as small "fingers-of-god" in Fig. |5]l 
which contribute to this effect at small scales. At larger scales 
{s ^ 5/1"' Mpc), the coherent bulk flows tend to increase ^(s) for 
the late spiral galaxies, which dominate in the medium and low 
density environments. In order to free the type measurements 
from the redshift distortion effect, we calculate in the following 
sections the projected spatial correlation function w(rp). 

5. The projected spatial correlation function w(rp) 
5. 1 . General behavior of w(rp) 

To measure w(rp), one must first calculate the correlation func- 
tion ^(rp,7r) as a function of separation parallel and perpen- 
dicular to the line-of-sight (see Sect. |Gll. Fig. |8] shows ^{rp,n) 
for all ESS galaxies using the LS estimator (Eq. |B.7t with 
the minimum-variance weights (Eq. ID. 3b and bin widths of 
2 Mpc. The contours of constant clustering amplitude are 
drawn as solid lines. Fig. |8] exhibits a stretching along the line- 
of-sight (n direction) for separations smaller than 4 h^^ Mpc, 
caused by the peculiar velocities within the numerous groups of 
galaxies present in the ESS (see Fig. |5]l. The flattening of the 
contours of ^(rp,7r) along the line-of-sight due to the coherent 
infall of galaxies onto the over-dense regions, w hich was first 
detected in the 2dFGRS bv lHawkins et al](l2003h . is hardly seen 
here, due to the limited angular extent of the ESS in right ascen- 
sion, which subtends ~ 8 /i"' Mpc at z ~ 0.2. 

Because ^(rp, n) is a decreasing function of both rp and n, 
one can estimate the projected real-space correlation function 
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Fig. 8. Line-of-sight/transverse correlation function ^(rp,n) for 
the ESO-Sculptor galaxies with 0.10 < z < 0.51, where rp and 
n are the separations perpendicular and parallel to line-of-sight, 
both measured in unit of /i ' Mpc. The grey levels (from white 
to black) and the contours of constant ^(rp, n) are linearly spaced 
from ^{rj,,7T) = 0.0 to ^{rp,7r) - 3.0 with steps of A^(rp,7r) - 
0.25. 



w(rp) by an integral over n (see Eq. lG.2l i. In practise, the integral 
can only be performed to a finite bound, which needs to be de- 
termined. To this end, we have calculated the various functions 
w(rp) with integration bounds of 6.31 /i"' Mpc, 12.59 /i"' Mpc, 
25.12 /j-i Mpc, and 50.12 h'^ Mpc. The 12.59 /i"' Mpc inte- 
gration bound appears as the smallest bound with evidence for 
stabilization, and we thus adopt this value. The chosen integra- 
tion bound of 12.59 Mpc also insures that the random noise 
fluctuations visible at larger values of n in Fig.[8]are excluded, as 
we interpret these as symptomatic of the limited sampling vol- 
ume of the ESS (see Sect. [Hi. 

The resulting projected real-space correlation function w(rp) 
for the full ESS sample is shown in Fig. |9] In the interval 
0.1 < Tp < 3 Mpc, w(rp) is well fitted by a power-law with 
parameters 

ro = 5.25+ 1.82 /i^'Mpc, y= 1.87 +0.07, (17) 

(the quoted uncertainties in ro and y ignore the correlation be- 
tween the various points of w(rp), and are therefore underesti- 
mated). 

5.2. Nature of the over-density at 0.41 < z < 0.44 

We also plot in Fig. |9] w{rp) for the ESS sample without the 
over-density. The resulting correlation function can be fitted by a 
power-law over a larger interval of rp than for the full ESS sam- 
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Fig. 9. Projected correlation function w(rp) for the ESO-Sculptor 
sub-sample including all galaxies (black filled circles), and af- 
ter removal of the over-density in the interval 0.41 < z < 0.44 
(green empty circles). The straight lines correspond to the best- 
fit power-laws whose parameters are given in Eqs.fTTjandfTSl 

pie: for 0.2 < rp < 10 Mpc, we obtain the following best fit 
parameters 

ro = 3.50+ 1.21 /i-'Mpc, y= 1.93 ±0.09. (18) 

The decrease in the amplitude ro of w(rp) from Eq.[T7]to Eq.fTSl 
with a nearly constant slope, indicates that the over-density at 
0.41 < z < 0.44 contributes excess pairs of galaxies at all scales. 
Note that w(rp) can be fitted by a power-law over a larger range 
of scales than ^{s) (compare Figs. |4] and |9]l, because the latter 
function is affected by the peculiar velocities (but see Sect. |6] 
for discussion of the small deviations at rp ^ 0.15 /z ' Mpc and 
rp ^ 1.0 /i"' Mpc in Fig.©. 

Close examination of Fig.|9]indicates that the over-density in 
the 0.41 < z < 0.44 redshift interval also has a differential effect 
on w(rp) at both small and large scales, with an excess clustering 
at rp $ 0.2 /i ' Mpc and 3 rp :^ 10 /z ' Mpc compared to the 
power-law fits. The small scale 0.2 ' Mpc corresponds to the 
typical virial radius of galaxy groups dYang et alj|2005d h. sug- 
gesting that the over-density may be due to richer groups than in 
the rest of the survey. Besides, the 3 Mpc intermediate scale 
is close to the min imum separation between the galaxy groups 
(lYang et al.l2005cl) . which suggest that the groups located within 
the over-density are more densely clustered than in the rest of the 
ESS. 

Calculation of w(rp) therefore clarifies the nature of the over- 
density, and quantifies the visual impression that this redshift 
interval contains richer groups and with a higher spatial con- 
trast than in the rest of the survey (see Fig. |5j. This region is 
thus clearly peculiar. Because of its large size and strong ex- 
cess in clustering, it has a visible impact on the ESS clustering 
measurements, which can be interpreted in terms of cosmic vari- 
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ance. When this structure is excluded, the ESS clustering mea- 
surements are in good agreement with the other measurements 
from larger redshift surveys at z ~ and z ~ 0.5 (see Sect. |7]). 
Moreover, there is enough clustering signal in the ESS survey 
outside the over-density for allowing us to measure the galaxy 
correlation functions. Thanks to a detailed account of the vari- 
ous selection effects related to the galaxy types and the luminos- 
ity functions, the signal-to-noise in the ESS correlation measure- 
ments when excluding the over-density is only slightly reduced. 
The gain in revealing the 1-halo and 2-halo components of dark 
matter halos (see Sect.|6ll largely compensates for this slight loss 
in signal-to-noise. 

In the following, we thus only consider the correlation func- 
tions obtained when the over-density at 0.41 < z < 0.44 is ex- 
cluded, as these best reflect the typical galaxy clustering. 

5.3. w(rp) per galaxy type 

FigHnishows the projected real-space correlation function w(rp) 
for each of the 3 ESS galaxy types: early-type, late spiral and 
dwarf galaxies. The relative behavior of w(rp) for the late spi- 
ral galaxies and early-type galaxies is somewhat similar to that 
seen in ^(s). The late spiral have a significantly weaker corre- 
lation function than for the early-type galaxies at small scales 
(rp < 0.3 /i"' Mpc). Then at larger scale, w(rp) for the late spi- 
ral galaxies has a very similar behavior to that for the early-type 
galaxies, with a comparable slope, and a factor ~ 1.5-2.0 lower 
amplitude. 

A remarkable result in Fig.[TO]is that for rp > 0.3 /i"' Mpc, 
the correlation function for the dwarf galaxies is consistent with 
null clustering within the error bars. This is best seen in Fig.fTTl 
which shows w(rp) in linear scale for the dwarf galaxies (with 
the same color coding as in Fig. [TOl i. Significant clustering of 
the dwarf galaxies is only detected for rp < 0.3 Mpc (with a 
2cr significance level). 

We emphasize the noteworthy differences in the correlation 
functions for the three galaxy types in Fig. [TOl First, pairs of 
early-type galaxies tend to dominate over pairs of both other 
galaxy types at all scales (except maybe at rp > 10 Mpc), 
and the effect is even stronger at small scales, rp < 0.3 /z ' Mpc. 
Once the early-type galaxies are set aside, the complementary 
clustering of the late spiral and dwarf galaxies is worth attention: 
dwarf galaxies have a dominating clustering at rp < 0.3 Mpc, 
and fall-off to null clustering at larger scales; in contrast, Fig.fTTl 
shows that w(rp) for the late spiral galaxies have moderate clus- 
tering at rp ^ 0.15 /z"' Mpc, a factor 2 below the dwarf galaxies; 
then w(rp) is consistent with null clustering at rp ^ 0.3 /i"' Mpc, 
whereas significant signal is detected at larger scales, from rp ^ 
0.6 /i"' Mpc to rp ^ 10 /i"' Mpc. 

These differences with galaxy types are quantified by the 
power-law fits of w(rp). For the early-type galaxies, we obtain 

ro = 3.80 + 0.67 /j^'Mpc, r = 2.11 +0.10 (19) 

(fit over the 0.15 < rp < 5 /z ' Mpc interval). For the late spiral 
galaxies, both the amplitude and the slope are smaller: 

ro = 2.72 ± 0.64 /z^'Mpc, y = 1.60 + 0.08 (20) 

(fit over the 0.15 < rp < 10 /i"' Mpc interval). In contrast, the 
dwarf galaxies have an even smaller amplitude and significantly 
steeper slope than for the giant galaxies: 

ro = 1.85 + 0.83 /z^'Mpc, y = 2.46 + 0.38 (21) 
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Fig. 10. Projected correlation function w(rp) for the ESO- 
Sculptor sub-samples per galaxy type: early-type galaxies (red 
filled circles), late spiral galaxies (green open diamonds), and 
dwarf galaxies (cyan open stars). For each galaxy type, the 
straight line corresponds to the best-fit power-law whose param- 
eters are given in Eqs.[T9]to|2T] The over-density in the interval 
0.41 < z < 0.44 has been removed from the early-type and late 
spiral samples. 



(fit over the 0.15 ^ rp < 2 .5 Mpc interval). 

BinggelietaD ('1990) showed from a local wide-angle sur- 
vey of low surface brightness galaxies that although dwarf galax- 
ies delineate the same large-scale structures as the giant galax- 
ies, there is a strong segregation among dwarf galaxies: (1) dE 
lie preferentially in concentrations of galaxies, whereas dl are 
more dispersed; (2) outside clusters, dE also tend to be satel- 
lites of giant galaxies. Indeed, studies of dense galaxy clus- 
ters show extensive populations of red dwa rf or dE galaxies 
(lAndreon & Cuillandrell2002l; lTrentham'l997^. In less dense en- 
vironments, one well-studied example being the Local Group, 
dE galaxies and the even fainter dwarf spheroidal (dSph) galax- 
ies are preferentially found as satellites of the giant spiral galax- 
ies, with typical distances < 0.1 h^^ Mpc; in contrast, the dl 
galaxies are more sparsely distributed, and in the Local Group, 
most of them populate the outskirts at distances of < 0.5 /z"' Mpc 
(http://www.astro.washington.edu/mayer/LG/LG.html). It is re- 
markable that the 2 quoted scales are consistent with the interval 
over which the ESS dwarf galaxies show significant clustering. 
In the picture of the local Universe, the dE would be responsible 
for the dwarf clustering at rp ^ 0.15 /z"' Mpc whereas the dl 
would contribute to the signal at rp ^ 0.3 h^^ Mpc. 

5.4. Cross-correlation of the giant and dwarf galaxies 

To directly measure how dwarf galaxies cluster around giant 
galaxies, we plot in Fig. [12] the cross-correlation w(rp) be- 
tween the dwarf galaxies and either the early-type galaxies or 
the late spiral galaxies. As for the auto-correlation function. 
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Fig. 11. Projected correlation function w(rp) in linear scale for 
the ESO-Sculptor late spiral galaxies (green open diamonds) and 
dwarf galaxies (cyan open stars). The over-density in the interval 
0.41 < z < 0.44 has been removed from the late spiral sample. 



we adopt the LS estimator with 73 weighting (see Sect. |B]i. 
Strikingly, the cross-correlation functions of the dwarf galaxies 
versus both types of giant galaxies show significant signal, with 
an amplitude comparable to or intermediate between the auto- 
correlation functions of the early-type and late spiral galaxies at 
< 5 /i ' Mpc (also shown in the graph). 

First, we have also calculated the dwarf versus giant galaxy 
cross-correlation functions after excluding the dE galaxies: the 
resulting curves are identical to those shown in Fig. [12] indi- 
cating that both the dE galaxies and the dl galaxies contribute 
similarly to the cross-correlation signal. The smaller number of 
dE galaxies in the dwarf sub-sample may nevertheless indicate a 
weaker correlation for these objects, compared to the dl galaxies. 

In Fig. [12] the cross-correlation of the dwarf versus early- 
type galaxies has a ~ 1.5-2 higher amplitude (Icr effect) than 
that for the dwarf versus late spiral galaxies, over the full scale 
range < 5 /i ' Mpc. Moreover, both functions have a com- 
parable amplitude as the auto correlation of the dwarf galax- 
ies at small scales (rp < 0.3 Mpc). At these scales, the 
auto-correlation of the early-type galaxies is stronger by a fac- 
tor ~ 2 (Icr effect) than the dwarf/early-type cross-correlation, 
and by a factor ~ 3 - 4 (2cr effect) than the dwarf/late spiral 
cross-correlation. This indicates that at rp < 0.3 Mpc, pairs 
of early-type galaxies may dominate over all the other types 
of pairs, namely late-spiral/late-spiral, dwarf/dwarf, dwarf/early- 
type, and dwarf/late-spiral pairs. It also suggests that the small- 
scale clustering of the dwarf galaxies may be due to the com- 
bined effects of them being satellites of early-type galaxies, and 
of the early-type galaxy clustering. 

In the intermediate scale range 0.6 < rp < 5 /i ' Mpc, mixed 
pairs of dwarf and giant galaxies appear to contribute equally 
to the clustering as pairs of giant galaxies, whereas pairs of 
dwarf galaxies are significantly less frequent. At larger scale 
(rp > 5/1"' Mpc), the cross-correlation signal of dwarf versus 
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Fig. 12. Projected cross-correlation function w(rp) of the ESO- 
Sculptor dwarf galaxies with the early-type galaxies (black filled 
circles) and the late spiral galaxies (blue open squares); both 
curves are connected by solid lines. For comparison, the auto- 
correlation function for the early-type (red filled circles), late 
spiral (green open diamonds), and dwarf galaxies (cyan open 
stars) are over-plotted, connected by dotted lines. The over- 
density in the interval 0.41 < z < 0.44 has been removed from 
the early-type and late spiral samples. 



giant galaxies vanishes, indicating that the remaining clustering 
signal is fully dominated by pairs of giant galaxies. 

The significant cross-correlation signal between the dwarf 
galaxies and the late spiral galaxies in the full scale range rp < 
5 /i ' Mpc, seen in Fig. [12] provides direct indication that the dE 
and dl galaxies are also clustered in the vicinity of the late spiral 
galaxies. However, the different behavior of the auto-correlation 
functions for the two galaxy populations, with the dominating 
clustering of the dwarf galaxies at rp < 0.3 Mpc and that 
of the late spiral galaxies at larger scales, may indicates that the 
two populations have distinct distributions at these scales. 

In Fig. [13] we compare the cross-correlation function of the 
dwarf versus late spiral galaxies with the cross-correlation of 
the late spiral versus early-type galaxies. We observe that at 
all scales with rp < 5 h^^ Mpc, both functions are indistin- 
guishabl41 whereas the amplitude of the dwarf versus early-type 
cross-correlation function (also plotted in Fig.[T3]l is a factor of 
1.5-2 higher (Icr effect). This suggests the interesting property 
that the clustering of the dwarf galaxies around late spiral galax- 
ies might be a consequence of how both galaxy types cluster in 
the environment of early-type galaxies. This is further developed 
in the next sub-section, where we interpret these observed clus- 



' The late spiral versus early-type cross-correlation function might 
be smoother than the dwarf versus late spiral cross-correlation because 
there are 72% more early-type galaxies than dwarf galaxies in the con- 
sidered samples (see Table[T}. 
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Fig. 13. The same cross-correlation functions as in Fig. [121 
namely the ESO-Sculptor dwarf versus early-type galaxies 
(filled black circles) and the dwarf versus late spiral galaxies 
(blue open squares), overlaid with the cross-correlation function 
of the late spiral versus early-type galaxies (magenta asterisks). 
The over-density in the interval 0.41 < z < 0.44 has been re- 
moved from the early-type and late spiral samples. 

tering properties in terms of the occupation of the dark matter 
halos by the different galaxy types. 

6. Interpretation in terms of dark matter haloes 

Based on respectively the 2dF Galaxy Redshift Survey (2dF- 
GRS hereafter) and the Sloan Digital Sky Survey (SPSS here- 
after), 'Magli occhetti & Porcianil (|2003|) and lZehavi et al.l (|2004 
showed evidence for a deviation of the projected correlation 
function w(rp) from a power-law, with a change of slope at 
Tp ^ 2 /i ' Mpc. Both groups of authors interpret this inflexion 
point as the transition from the small-scale regime where pairs of 
galaxies located within the same dark matter halos dominate (de- 
noted hereafter "1-halo component"), to the large-scale regime 
where pairs of galaxies residing in separate halos overtake the 
clustering signal (denoted hereafter "2-halo component"), this 
transition occurring near the virial diameter of the halos. This 
interpretation is further confirmed by the excellent fit of the ob- 
served deviations of w(rp) from a power-law using the general 
formalism of the "halo occupation distribution" (HOD her eafter; 
iMapliocchetti & Porcianilllool IZehavi et al.ll2004 lIOOSi) . This 
approach has the advantage of providing an anal ytical descrip- 
tion of the clustering of biased ga laxy populations jBenson et al.l 
l2000tlBerlind & Weinbergl2002l) . and comparison with observa- 
tions provides constraints on the HOD parameters. 

The projected correlation function w(rp) for the full ESS 
sample without the over-density at 0.41 < z < 0.44, shown in 
Fig. |9] displays a similar deviation from a power-law, with an 
inflexion point at ~ 1 /i ' Mpc. At scales smaller than the in- 
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Fig. 14. Projected cross-correlation function w(rp) of the ESO- 
Sculptor late spiral galaxies with the early-type galaxies (ma- 
genta asterisks). For comparison, the auto-correlation functions 
for the early-type galaxies (red filled circles) and the late spi- 
ral galaxies (green open diamonds) are also shown. The over- 
density in the interval 0.41 < z < 0.44 has been removed from 
the early-type and late spiral samples. 

flexion point, the correlation function vv(rp) is poorly fitted by a 
power-law. This matches the theoretical expectation that the 1- 
halo component fol lows the halo mass function, which flattens 
off at small scales jZehavi et all 2004; Jenkins et al. 2001). At 
Tp ~ 1 /i ' Mpc, the 2-halo regime takes over and is determined 
by the matter correlation function and the halo bias dZehavi et al.l 
|2004|) . At larger scales, the correlation function is also expected 
to deviate from a power-law, but this is not visible in Fig. |9l due 
to limited statistics. 

6.1. Dependence on galaxy type 

We now turn to the analysis of the ESS correlation functions 
by galaxy type, as they provide a new insight into the con- 
tribution of the different galaxy populations to the halo com- 
ponents. Fig. [To] shows that for the three ESS galaxy types, 
w{rp) does deviate from a simple power-law fit. For the early- 
type galaxies, the 1-halo to 2-halo transition is clearly detected, 
and is located at rp ^ 1 /i ' Mpc. Moreover, both the 1-halo 
and 2-halo components have the similar non power-law behav- 
ior as that measured from the 2dFGRS early-type galaxies by 
Magliocchetti & Porciani (2003); the two compo nents a re mod- 
elled by a standard mass profile (INavarro et aTl IT997I) . and a 
prescription for the two-point correlation function of dark mat- 
ter halos respectiv ely. Similar results a nd modelling are derived 
from the SDSS bv Zehavi et"an (l2005h . 

Nevertheless, there are indications of differences between 
the ESS early-type clustering and those measured locally from 
the 2dFGRS and SDSS: an apparently smaller transition scale of 



15 



Tp ^ 1 /i ' Mpc, instead of rp ^ 2 /i ' Mpc; and the fall-off of the 
ESS large-scale clustering power at rp > 10 /i"' Mpc, whereas 
both the 2dFGRS and SDSS have significant clustering out to at 
least Tp ^ 20 /i"' Mpc. The cut-off at rp ^ 10 /i"' Mpc for all 
the ESS auto and cross-correlation functions is likely due to the 
limited angular extent of the survey: its angular size is ~ 1.0°, 
which subtends rp ^ 10 /i ' Mpc at the median redshift of the 
survey (z - 0.3); as a result, any existing correlation signal be- 
yond ~ 10 /i ' Mpc cannot be detected in w(rp). In contrast, the 
smaller transition scale in the ESS may be real and could be due 
to evolution effects related to the higher redshift range of the 
ESS (0.1 < z < 0.5) compared to z < 0.1 for the 2dFGRS and 
SDSS. 

Fig. [To] shows that the higher amplitude and slope of the 
ESS early-type auto-correlation compared to that for the late 
spiral galaxies can be decomposed into a 50% higher ampli- 
tude but similar slope for the 2-halo component, and a factor 
~ 2 - 4 higher amplitude and significantly flatter slope for the 
1-halo component. This is in good agreement with the results 
obtain ed by iMaghocchetti & Porcianil ( l2003i) and IZehavi et alj 
(I2005h from the 2dFGRS and SDSS respectively. These au- 
thors successfully model the clustering of both galaxy types 
(early/red, late/blue) using the HOD prescription, which con- 
firms that both galaxy types follow the dark matter distribution 
within the halos. 

One of the major predictions of hierarchical clustering is that 
the m ost massive halos have the strongest two-point clustering 
jZheng et al.l2002l) . In this context, the 50% excess amplitude of 
the early-type auto-correlation function over that for the late spi- 
ral galaxies in the 2-halo regime indicates that early-type galax- 
ies tend to reside in more massive halos than the late spiral galax- 
ies. Moreover, the relative behavior in the 1-halo regime shows 
that the excess of early-type clustering is even stronger within 
the halos, and increases at higher clustering levels. Given that the 
clustering is stronge r in higher density reg ions, at all scales from 
0.1 to 30 /! ' Mpc dAbbas & She th 2006) and that the density 
increases towards the center of the halos dNavarro et alJll997l) . 
the excess small scale clustering of the ESS early-type galaxies 
is consistent with them being preferentially located at smaller 
radii from the halos centers than the late spiral galaxies. 

The auto-correlation function of the ESS dwarf galaxies 
can also be conveniently interpreted in terms of halo member- 
ship. Fig. [To] shows a clear 1-halo component which falls off at 
rp > 0.3 /i"' Mpc, thus indicating that the dwarf galaxies are con- 
fined to the densest parts of the halos. This is in agreement with 
the fact that these regions are dominated by early-type galaxies, 
and that dwarf galaxies are preferentially satellites of early-type 
galaxies (see Sect. |5.4| i. A possible weak 2-halo component of 
the dwarf galaxies at 1 < rp < 2 /z"' Mpc (Fig. [TOt could be 
the replica of the early-type 2-halo component with the appro- 
priately scaled amplitude. 

Information on the degree of mixing of the early-type and 
late spiral galaxies within halos can be obtained from their cross- 
correlation function. It is displayed in Fig. [14] where it is com- 
pared with the auto-correlation functions w(rp) for both galaxy 
types. The cross-correlation is close to the mean of the two auto- 
correlation functions at all scales but rp ~ 0. 15 /i"' Mpc. In the 2- 
halo regime, this is naturally expected and provides no additional 
inform ation over the auto-correlation functions (jZehavi et alj 
12005 ^. In contrast, in the 1-halo regime, it suggests that both 
galaxy types are well mixed within halos at rp > 0.3 Mpc, 
that is that they do not avoid residing in th e same halos. Using 
the cross-correlation function. IZehavi et al.l (l2005h also found a 



good level of mixing of the red and blue SDSS galaxies, at all 
scales of the 1-halo regime. 

Nevertheless, in the ESS analysis presented here, the iden- 
tical amplitude of the early-type versus late spiral cross- 
correlation function and the late spiral auto-correlation function 
at rp ^ 0.15 Mpc, together with a factor ~ 5 higher am- 
plitude for the early-type auto-correlation function at this scale 
indicate a lack of mixing of the two galaxy types: pairs of early- 
type galaxies dominate over pairs of late spiral galaxies and 
cross-pairs of early-type and late spiral galaxies. We notice that 
rp ^ 0.15 /i ' Mpc is also the sm allest detected scale of cor- 
relation si gnal in the 2dFGRS ( IMaghocchetti & Porcianill2003l) 
and SDSS dZehavi et al.ll2005h . which have higher statistics than 
the ESS. This scale is likely to correspond to the highest den- 
sity regions, hence to the very centers of the most massive ha- 
los (Navarro et al. 1997). The cross-correlation functions there- 
fore bring the additional information that the centers of the most 
massive halos are dominated by pairs of early-type galaxies. 
Conversely, these observations suggest that the late spiral galax- 
ies tend to lie either in the outer regions of the densest halos or 
in the centers of less dense halos. 

These results are consisten t with the HOD-based model pro- 
posed by IZehavi et alj d2005 ^, in which blue galaxies are the 
central galaxies of the least massive halos, whereas red-type 
galaxies are the central galaxies in all other halos, including 
the most massive. Such a segreg ation effect is also detected by 
iMagliocchetti & Porcianil d2003l) . whose HOD modelling using 
a common dark matter profile can successfully predict w(rp) for 
both the early-type and late-type galaxies, provided that the for- 
mer populate the halos out to one virial radius, and the latter are 
allowed to extend out to twice that distance. The marked deficit 
of pairs of ESS late spiral galaxies at rp ^ 0.3 /i"' Mpc (see 
Fig. [To] ) could be interpreted as further evidence that a signifi- 
cant part of these objects tend to populate the outer regions of 
the halos. 

6.2. Dependence on galaxy luminosity 

It has been widely observed that intrinsically luminous galaxies 
cluster mor e strongly than faint ones (e.g. Benoist et al. 199^ 
IGuzzo et al.l2000HZehavi et alJ2002l) . To examine whether such 
systematic variations are present in the ESS, we separate the 
early-type and late spiral galaxies into bright and faint sub- 
samples using the median absolute magnitude of each sample: 
-21.14 for the early-type galaxies, -20.56 for the late spiral 
galaxies; the corresponding numbers of galaxies for the sub- 
samples are listed in Table [T] The resulting projected auto- 
correlation functions w(rp) for both the early-type and late spiral 
sub-samples are displayed in Fig. [15] using filled, open symbols 
for the bright and faint sub-samples respectively. 

For the early-type galaxies (left panel of Fig. [TSl l, the cor- 
relation function is unchanged when restricting to the bright 
sub-sample, except at rp ^ 0.15 /z ' Mpc where the signal de- 
creases by a factor ~ 2, and at rp ^ 10 Mpc where the 
signal vanishes. The faint sub-sample has nearly the same clus- 
tering strength as the full early-type sample at rp ^ 1 Mpc; 
then the correlation function decreases to nearly half that for the 
bright galaxies at rp ^ 2.5 /i ' Mpc, and the power vanishes 
beyond. Altogether, the relative behavior of the early-type lu- 
minosity sub-samples indicates that in the 1-halo regime, both 
sub-samples contribute equally, with maybe a dominant contri- 
bution from the fainter galaxies at the very small scale rp ^ 
0.15 Mpc. Whereas in the 2-halo regime, the bright early- 
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Fig. 15. Projected correlation function w(rp) for the ESO-Sculptor sub-samples split at their median absolute magnitude: the early- 
type, late spiral galaxies are shown in the left and right panels respectively; the filled symbols and solid lines mark the bright sub- 
samples, the open symbols and dotted lines the faint sub-samples. In both panels, the over-density in the interval 0.41 < z < 0.44 
has been removed from the samples. 



type galaxies tend to domin ate at rp > 2.5 h^^ Mpc. This is in 
agreement with the results of IZehavi et al.l (12005 ) that bright red 
galaxies exhibit the strongest clustering at large scale, whereas 
faint red galaxies exhibit the strongest clustering at small scales. 
The authors reproduce this behavior using an HOD model in 
which nearly all faint red galaxies are satellite in high mass ha- 
les. 

When compared to the early-type galaxies, the relative clus- 
tering of the faint and bright late spiral galaxies (right panel of 
Fig. [15]) shows a somewhat similar behavior at large scales, and 
a difference at small scales. Indeed, the 2-halo component of the 
bright late spiral sub-sample is consistent with a factor ~ 2 - 5 
(Icr deviation) stronger clustering than for the faint sub-sample. 
In contrast to the early-type galaxies, the 1-halo component of 
the bright late spiral sub-sample tends to have stronger clustering 
than for the faint sub-sample. This is again in agreement with the 
steadily decreasing amplitude of w{rp) for the faint blue SDSS 
galaxies. At variance with the early-type galaxies, there is no in- 
dication of excess clustering of the faint late spiral galaxies at 
Tp ^ 0.15 /i"' Mpc; on the contrary, they might be less clustered 
than their bright analogs. 

Yet another prediction of hierarchical clustering is that lu- 
minous galaxies are expected to be preferentially located within 
massive halos, which in turn are more strongly clustered. Here 
again, although the clustering deviations in the luminosity sub- 
samples of the early-type and late spiral galaxies are only signifi- 
cant at the 2cr level at most, we take them at face value and derive 
an interpretation in terms of dark matter halo membership. The 
excess clustering in the 2-halo regime of the ESS bright sub- 
samples over the faint sub-samples, which is detected for both 
the early-type and late spiral galaxies in Fig. [T5j is consistent 
with this expected property of hierarchical clustering. 

In contrast, the difference in the relative behavior of the 1- 
halo components for the early-type and late spiral galaxies sug- 



gests that the two galaxy types trace the dark matter profiles of 
the halo in a different way. In the previous section, we suggested 
that early-type galaxies tend to occupy the centers of the most 
massive halos, and that late spiral galaxies tend to lie either in 
the centers of less dense halos and/or in the outer regions of the 
densest halos. The additional information brought here is that 
this is nearly independent of luminosity for the early-type galax- 
ies, whereas faint late spiral galaxies might tend to reside in even 
less dense regions than their bright analogs. This implies a spe- 
cific spatial segregation of the early-type and late spiral galaxies 
inside the dark matter halos. 



7. Comparison with other surveys 

Before the establishment of the currently sta n dard cosmology 



= 0-3 and Da - 0.7 jRiess et al 



[T999I: iPhinipsetaP l200lt iTonrvet al.lboosl) . various surveys 



19981; iPerknutter et all 



have obtained measures of the galaxy two-point correlation 
function in redshift space and/or projected separation assum- 
ing either a low or high matter density Unive rse and a 

null cosmological constant (at j. ^ 0.1 - 0.5: 'Cole et ajj 

1994; Le Fevre et al. 1996; Small et alJll999l;lG uzzo et al. 200^ 
iHogg et a l. 2000; Carlberg et al. 2000; Shepherd et al. 2001; at 
z ^ 0: iLoyedav etal.. .1992; Park etal .1994; Baugh 19961; 
iTucker et alJll997t iRatchffe et alJll998briGiuricin et alTT200ll) . 
To compare our results with those from the other surveys, we 
thus consider only the more recent measurements, which use the 
new standard cosmological parameters. 

We specifically focus on the projected-separation correlation 
function w{rp) and list in Table [3] its amplitude and slope ob- 
tained for the full ESS sample without the over-density in the 
redshift interval 0.41 < z < 0.44. For comparison, we list the 
measurements from the SDSS, the 2dFGRS, and the VIMOS- 
VLT Deep Survey (VVDS). The ESS values are in good agree- 
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Table 3. Parameters of power-law fits to the projected-separation correlation function for other redshift surveys. 



Survey 


Redshift range 


Absolute magnitude range 


Numb. 


ro ( h' 


Mpc) 




7 


Reference 


Galaxy type 


















ESS 


0.1 < z < O.Slf 


- 51og/i < -16.0 


654 


3.50 


± 1.21 


1.93 


± 0.09 


present analysis 


VVDS 


0.1 < z < 0.5 


Mb - 5 log/! < -17.0 


1 089 


3.0 


± 0.5 


1.7 


± 0.1 


Polio et al. (2006) 


SDSS 


z < 0.04 


M,. - 5 log/! < -18.0 * 


8 730 


3.7 


± 0.3 


1.87 


± 0.05 


Zehavi et al. (2005) 


SDSS 


z < 0.06 


M,. -51og/!<-17.0* 


23 560 


4.6 


± 0.2 


1.89 


± 0.03 


id. 


2dFGRS 


0.01 < z < 0.20 




165 659 


5.0 


± 0.3 


1.70 


± 0.03 


Hawkins et al. (2003) 


ESS: 


















- eaiiy-type galaxies 


0.1 < z < 0.51 


- 5 log/; < -16.0 


218 


3.80 


± 0.67 


2.11 


± 0.10 


present analysis 


- late spiral galaxies 


0.1 < z < 0.51 


Mr^. - 51og/! < -16.0 


279 


2.72 


± 0.64 


1.60 


± 0.08 


id. 


- dwarf galaxies 


0.1 < z < 0.51 


Mr^ - 51og/! < -16.0 


159 


1.85 


± 0.83 


2.46 


± 0.38 


id. 


VVDS: 


















- elliptical/so galaxies 


0.2 < z < 0.6 


MB,,^-51og/!<-15.0 


164 


3.1 


± 0.8 


2.4 


± 0.3 


Meneux et al. ("2006) 


- Sb-Sc galaxies 


0.2 < z < 0.6 


Mb^s -51og/! < -15.0 


736 


2.8 


± 0.4 


1.9 


± 0.2 


id. 


- Magellanic irregulars 


U./ < Z < U.O 


Mg^g — J logn < — ij.U 


jU / 


1. / 


± U.O 


1 

i.o 


_i_ n 1 
± U. 1 


la. 


2dFGRS: 
















- passive galaxies 


0.01 < z < 0.20 




36 318 


6.05 


±0.35 


1.94 


±0.03 


Madswick et al. (2003) 


- active galaxies 


0.01 < z < 0.20 




60 473 


3.89 


±0.31 


1.55 


±0.04 


id 


SDSS: 


















- red galaxies 


0.03 < z < 0.07 


-20 < Mr - 5 log /l<- 19.0* 


5 804 


5.7 


±0.3 


2.10 


±0.05 


Zehavi et al. (2005) 


- blue galaxies 


0.03 < z < 0.07 


-20<M, -51og/i<-19.0* 


8 419 


3.6 


±0.3 


1.70 


±0.05 


id. 


SDSS: 


















- red w(d) 




-21 < M,. -51og/! 


343 


6.59 


±0.17 


1.96 


±0.05 


Budavari et al. ("2003) 


- blue wid) 




-21 <M,. -51og/! 


316 


4.51 


±0.19 


1.68 


±0.09 


id. 



Notes: 

t The over-density in the interval 0.41 < z < 0.44 is excluded from the listed redshift interval. 

* The star symbol in the absolute magnitude range column indicates that the corresponding sample is volume limited to the quoted absolute 
magnitude limits. Elsewhere, the indicated absolute magnitude results from the combination of the apparent magnitude and redshift limits of 
the sample. 



ment with those obtained from the VVDS jPoUo et al.ll2006l) in 
a similar redshift interval. The comparatively higher ESS ampli- 
tude ro = 5.25 + 1.82 /i"' Mpc, derived when the over-density at 
0.41 < z < 0.44 is included, strengthens our conclusion that this 
structure is a peculiar region of the survey. 

The parameters of w(rp) derived from the ESS are also con- 
sistent with tho se obtained from th e 8 730 SDSS galaxies with 
Mr < -18.0 dZehavi et al.1 l2005l) . Our value of ro is never- 
theless below that obtained from 23 560 SDSS galaxies with 
Mr < -17.0 (IZehavi et al.ll2005l) . and that from 165 659 2dF- 
GRS galaxies (for supposedly Mi,j < -17.5. iHawkins et al.l 
I2OOI . In a ACDM universe undergoing hierarchical cluster- 
ing, an evolution in ro is expected between redshifts and 0.5 , 
specifically a decrease b y ~ 0.5 /i ' Mpc dBenson et al.ll200ll 
iKauffmann et al.l ll999b). Although such a variation is compati- 
ble with the comparison of the ESS and the local SDSS and 2dF- 
GRS correlation measurements, the wide error bars of the ESS 
correlation function do not allow us to draw any firm conclusion 
on the evolution in ro. 

The second part of Table |3]Hsts the parameters of the power- 
law fits to w(rp) for the same surveys as quoted in the top of 
the Table, split by galaxy type. For the VVDS, we list the mea- 
surements for the elliptical/so (type 1) , Sb-Sc spiral (type 2 ) and 
Magellanic irregular galaxies (type 4) jMeneux et al.l2006h : note 
that we do not consider the c orrelation func t ion for galaxy types 
Sc-Sd (type 3) measured by iMeneux et al.l (12006'). because the 
results are nearly identical to those for types Sb-Sc; moreover, 
among the ESS late spiral galaxies, intermediate-type galaxies 
which correspond to Sb-Sc type dominate in number over later 



type galaxies (see Table[TJ. Both the ESS early-type and VVDS 
elliptical/so on the one hand, and the ESS late spiral and the 
VVDS Sb-Sc galaxies on the other hand, have values of the am- 
plitude ro and the slope y which are in Icr agreement. The am- 
plitude for the ESS dwarf galaxies and the VVDS Magellanic ir- 
regulars are also in good agreement, whereas the slope is signif- 
icantly steeper in the ESS. The slope of w(rp) for the ESS dwarf 
galaxies could be even steeper as the signal at rp > 1 /i ' Mpc 
may not be real in this population (see Fig. [TOl i. 

At the smaller redshifts covered by the SDSS and 2dFGRS, 
the correlation function for the red galaxies has a higher ampli- 
tude and_stee2er_slope than for the blue galaxies dZehavi et^TI 
I2OO5I: iMadgwick et al.ll2003.) . indicating similar segregation ef- 
fects as in the ESS. This type effect was also detected fro m the 
SDSS angular correlation function ( Budavari et al.ll2003t) . with 
good agreement in the power-law parameters. Note however that 
the correlation functions by galaxy type for the SDSS and 2dF- 
GRS have higher amplitudes than for the ESS and VVDS, which 
may also be the trace of clustering evolution. 

8. Summary of results 

We calculate the two-point correlation function for the ESO- 
Sculptor redshift survey. The sample is limited to the 765 galax- 
ies with Rc < 21.5 in the redshift interval 0.1 < z < 0.51. 
We use on the one hand the template free spectral classifica- 
tion of the sample into early, intermediate, and late-type galax- 
ies, which correspond to the following mixes of morphologi- 
cal type: E -H SO + Sa, Sb + Sc, and Sc + Sd/Sm, respectively 
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dGalaz & de Lapparentlll998l) : and on the other hand the results 
of the ESS luminosity function analysis, which indicates that the 
three ESS spectral classes contain two additional components, 
dwarf elliptical and dwarf irregular galaxies, mixed into the in- 
terme diate and late-type classes respectively jde Lapparent et all 
I2003h . This leads us to separate the intermediate-type and late- 
type spectral classes into their giant and dwarf galaxy compo- 
nents, which we merge into two classes dominated by late spi- 
ral (Sb -I- Sc + Sd/Sm), and dwarf (dE + dl) galaxies respec- 
tively. The resulting three galaxy classes (early-type, late spiral, 
dwarf galaxies) are therefore defined by spectral/morphological 
and luminosity criteria, which are both relevant for studying seg- 
regation effect in galaxy clustering. We use the corresponding 
Schechter and Gaussian luminosity functions for defining the se- 
lection function for each of the three galaxy types. 

We te st the various estirnator s of the correlation function, and 
adopt the lLandv & Szalavl (1 1993) estimator with 73 weighting, 
which combines stability and minimum variance. The redshift- 
space correlation function ^(s) can be fitted by a power-law with 
ampUtude so = 7.49 + 3.18 Mpc and slope y = 0.90 + 0.13 
in the interval 0.5 < 5 < 5 /i"' Mpc. At larger scales, ^(s) 
oscillates between negative and positive low amplitude values, 
with a peak at ~ 35 /i"' Mpc and its multiples. This is due to 
the combination of the pencil-beam geometry of the ESS sur- 
vey with the alternation of walls and voids, as demonstrated 
by a pair separation analysis. The ESS also contains an over- 
dense region located in the redshift interval 0.41 < z < 0.44, 
which affects the correlation function by adding excess large- 
scale power in ^(s). When removing this region, the power-law 
fit to ^(s) yields so = 4.22 + 1.15 /i"' Mpc and y = 1.22 + 0.15 
(in 0.5 < s < 5 Mpc), in better agreement with the other 
existing surveys. 

We then calculate the redshift-space correlation function ^{s) 
for the three galaxy types. These show marked differences, with 
a dominant signal originating from the early-type galaxies at 
nearly all scales. The late spiral galaxies show a weaker correla- 
tion amplitude at small a nd large scales, in a greement with the 
type-density relationship ('B lanton et al.l2005h . The new result is 
that the dwarf galaxies show a very steep correlation function 
over a narrow range of scales: ^(s) decreases from the clustering 
amplitude of the early-type galaxies at very small scale, to more 
than one order of magnitude weaker at rp ^ 4 /i ' Mpc. These 
segregation effects in the two-point clustering quantify the visual 
impression drawn from the redshift cone of the ESS. 

To free the correlation function measurements from the ef- 
fect of peculiar velocities, as they decrease the clustering ampli- 
tude at small scales due to random motions and increase its am- 
plitude at large scales due to coherent bulk flows, we then calcu- 
late the real-space correlation function as a function of projected 
separation w(rp). This is done by integrating the 2-dimensional 
correlation function ^(rp, n) along the line-of-sight separation n. 
The resulting projected-separation correlation function w{rp) can 
be adjusted by a power-law over a larger range of scales than 
^{s), from 0.15 Mpc to 10 /i"' Mpc. In this scale range, 
and after removing the over-density at 0.41 < z < 0.44, we 
obtain a best fit amplitude ro - 3.50 ± 1.21 /i"' Mpc and a slope 
7 = 1.93 + 0.09 which, as expected, is significantly steeper than 
that measured from ^(s). 

When splitting the ESS by galaxy type, the projected- 
separation correlation function w(rp) shows similarities with 
^(s), with again the early-type galaxies dominating over the 
other types at all scales. At variance with ^(s), the dwarf galax- 
ies clustering dominates over the late spiral galaxies at rp ^ 
0.15/1"' Mpc. At larger scales, the dwarf galaxies have a spatial 



correlation function consistent with null clustering, whereas the 
late spiral galaxies take over at rp > 0.6 /i"' Mpc, with a similar 
shape of the correlation function as for the early-type galaxies 
and a 50% lower amplitude. 

Comparison of ^{s) and w(rp) with and without inclusion of 
the over-dense region at 0.41 < z < 0.44 provides useful clues 
on the nature of this region: the excess clustering appears en- 
tirely due to the fact that it contains richer and more densely 
clustered groups of galaxies than in the rest of the survey; and 
both the early-type and late spiral galaxies contribute to the ex- 
cess clustering in the region. We then consider that the correla- 
tion functions for the ESS survey without the over-density are 
more representative of the overall galaxy distribution. 

A subsequent analysis of the cross-correlation of the dwarf 
galaxies with the early-type and late spiral galaxies provides di- 
rect evidence that the dwarf galaxies are satellites of the giant 
galaxies. At rp < 0.3 /?"' Mpc, pairs of early-type galaxies dom- 
inate over all the other types of pairs. Pairs of dwarf/early-type 
galaxies, dwarf galaxies, dwarf/late spiral galaxies, and late spi- 
ral galaxies are the next contributors to the small-scale two-point 
clustering, in decreasing order of contribution to the correlation 
function. In the intermediate scale range 0.3 < rp < 5 /; ' Mpc, 
mixed pairs of dwarf and giant galaxies contribute equally to the 
clustering as pairs of giant galaxies. Then at rp ^ 10 /i"' Mpc, 
the clustering signal is dominated by pairs of giant galaxies. 
Moreover, the cross-correlation analysis indicates that dwarf and 
late spiral galaxies are not well mixed at rp < 0.3 /z"' Mpc. 
Altogether, this suggests that the clustering of the dwarf galax- 
ies around late spiral galaxies at rp < 5 /z"' Mpc may be an 
indirect consequence of how both galaxy types cluster in the en- 
vironment of early-type galaxies. 

We then interpret the variations in the correlation function 
with galaxy type in terms of membership to the underlying dark 
matter halos. This approach is eased by the separation into the 
giant and dwarf galaxies, as they exhibit a clear dichotomy in 
their halo components: the correlation function for the early-type 
galaxies shows a dip at rp ^ 1 /i"' Mpc, which is interpreted as 
the transition between the regimes in which the 1-halo and 2- 
halo pairs dominate resp., and both components show a signif- 
icant contribution; in contrast, the dwarf and late spiral galaxy 
correlation functions are dominated by their 1-halo and 2-halo 
components, at small and large scales respectively. Altogether, 
this indicates that early-type galaxies tend to lie predominantly 
at the centers of the massive halos, whereas late spiral galaxies 
tend to lie either in the centers of less dense halos and/or in the 
outer regions of the densest halos. The small scale clustering is 
then not only determined by the dominant galaxies in the mas- 
sive halos, but also by their dwarf satellites. 

We also examine the two-point clustering for the bright and 
faint sub-samples of the early-type and late spiral galaxies. For 
both the early-type and late spiral galaxies, we detect a 1 cr excess 
clustering in the 2-halo regime of the bright sub-samples over the 
faint sub-samples, which is consistent with the expected proper- 
ties of hierarchical clustering: the most massive halos have the 
strongest 2-halo clustering, and luminous galaxies are preferen- 
tially located within massive halos. Comparison of the 1-halo 
component brings the additional information that the relation- 
ship between halo mass and giant galaxy type is nearly indepen- 
dent of luminosity for the early-type galaxies, whereas faint late 
spiral galaxies might tend to reside in even less dense regions 
than their bright analogs. 

At last, we compare our results with those from the other 
published analyses. Our power-law fits to w(rp) for the full ESS 
sample, and for the sub-samples by galaxy type are consistent 
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with those measured at comparable and lower redshifts from the 
other surveys. 



9. Discussion and perspectives 

9.1. The halo components of the correlation function 

One of the major results obtained here from the ESO-Sculptor 
redshift survey is that the projected-separation correlation func- 
tion w(rp) for each of the three galaxy types (early-type, late 
spiral and dwarf galaxies) presents marked deviations from a 
power-law, which can be interpreted as the transition between 
galaxies belonging to a same dark matter halo, and galaxies be- 
longing to two different halos. This provides conf irmation that 
the re sults obtained at low redshift (z $ 0. 1) by IZehavi et al.l 
(l2005b and iMaghocchetti & Porciaiiil (|2003[) extend to higher 
redshift (z ^ 0.5). A similar result was recently obtained at even 
higher redshifts (z ^ 1.2) based on the COMBO 17 survey with 
broad and rnedium band photometric redshifts (cr(z)/z ~ 0.01; 
iPhleps et al.ll2006l ). The ESS brings a useful confirmation based 
on spectroscopic redshifts, with o-(z) ~ 0.00055 at 0.1 < z < 
0.51. 

In this context, the ESS results provide evidence in favor of 
the gravitational instability scenario for the formation of struc- 
ture, in which the evolution of galaxy clustering is dr iven by 
the hie rarchical merging of halos. Most recently, Conro y et al.l 
( |2006|) have directly demonstrated that high-resolution dissipa- 
tionless ACDM simulations can reproduce the observed bimodal 
behavior of the correlation function for absolute magnitude- 
limited samples at various redshift limits: these results are en- 
tirely based on combining the spatial clustering of the halos with 
a prescription that relates the galaxy luminosities to the maxi- 
mum circular velocity of the sub-halos at the time of accretion. 
The hierarchical merging scenario is further validated by the de- 
tailed shape of the correlation functions for ESS early-type and 
late spiral galaxies, which allow a straightforward identification 
of the 1-halo and 2-halo components. 

Direct modelling of the projected-separation correlation 
function usin g the "Halo Occupation Distribution" (HOD) 
dBenson et al .'2000;'B erlind & Weinberg|l2 002). or the more re- 
fined "Conditional Luminosity Function" approach (which takes 
into account the luminosity and colour distributio n of galax - 
ies within dark matter halos of varying mass; Yang et al.|!2003|), 
provides constraints on the halo parameters describing th e cen- 
tral a n d satellite galaxies pararneters (Magliocchetti & Porciany 
20031; iPhleps & Meisenheimed |2003i; Abazaiian et al.. .20051 
Zehavi et al. II2OO5; Coorav 2006|). Nevertheless, several mea- 



surements of the correlation function at small scale also chal- 
lenge the current version of the halo model for galaxy clustering: 
the very small scale clustering of luminous red galaxies from the 
SDSS is too steep and would require either a steeper dark halo 
profile or a galaxy distribution which is steeper than the dar k 
matter at s cales 0.01 ^ rp < 0.1 /i ' Mpc jMasiedi et al.ll2006l) . 
In contrast. [Diaz et all (12005 ) obtained projected density profiles 
of galaxy groups wh ich are too flat compared to the standard 
iNavarro et al] (1 19971) profile. 

9.2. Early-type versus late spiral segregation 

The second major result obtained from the ESS is the markedly 
different clustering properties of the two giant galaxy types, 
early-type and late spiral. Both types have comparable 2-halo 
components with a 50% higher amplitude for the early-type 
galaxies, whereas the 1-halo component of the early-type galax- 



ies largely dominates over that for the late spiral galaxies. These 
results are remarkably similar to the predicted correlation func- 
tions calculated by Kauffmann et al. ( 1999a) in a ACDM semi- 
analytical simulation, which exhibit a higher amplitude and 
steeper slope for the early-type/red galaxies, and a lower am- 
plitude and a marked small-scale flattening at rp < 1.0 /i ' Mpc 
for the starforming galaxies. 

In the framework of hierarchical clustering of the dark mat- 
ter halos, our results imply a specific spatial segregation of the 
early-type and late spiral galaxies inside the dark matter halos, 
with the early-type galaxies residing in the center of the most 
massive halos, whereas the late spiral reside in their outskirts 
or in less dense halos. These segregation effects are consistent 
with the 50% higher p airwise velocity dispersion measured by 
iMadgwick et"ai]l2003b for the 2dFGRS passive galaxies com- 
pared to the starforming galaxies, as it indicates that the passive 
galaxies inhabit preferentially the cores of high-mass virialized 
regions. 

The link between the ESS type-segregation effects and the 
dark matter halos also finds direct confirmatio n from other re- 
cent analyses b a sed on group catalogs. Zandiva rez et al.l (|2003|) 
and I Yang et al] (l2005ci) show that the clustering properties of 
galaxy groups in the 2dFGRS match those of th e dark matter 
halos in ACDM N-body simulations. lYang et al] (l2005b ) thus 
derive a "halo-based" group finder algorithm which is optimized 
to associate a group to those galaxies which belong to the same 
dark matter halo. This allows one to directly examine the link 
between g alaxies and their dark matter halos. Most interestingly, 
lYang et a l. (2005c) separate the galaxy correlation function into 
the 1 -group and 2-group components, and thus directly measure 
the individual 1-halo and 2-halo components. 

The detected different distribution of ESS early-type and late 
spiral galaxies inside the dark matter halos raises the issue of 
whether the effect is due to each population belonging to differ- 
ent types of halos, or whether both galaxy types coexist within 
the same halos, but with a different spatial distribution. In the 
former case, the segregation effect would be related to the global 
halo properties like mass, whereas in the latter case, it would 
be related to the local properties such as dark matter density. 
The existence of both a 1-halo and 2-halo components in the 
cross-correlation function of the two ESS giant galaxy types 
(see Fig. [T4b indicates that both effects may be at play. This is 
confirmed from the analyses performed with the 2dF GRS group 
catalog ue of Yang et al. (2005b): on the one hand, lYang et al] 
dlOOSah measure that central galaxies in high-mass, low-mass 
halos are mostl y early-type , respec tively late-type galaxies; on 
the other hand, Yang et al] (12005 dh obtain direct evidence that 
early-type galaxies are closer to the luminosity-weighted group 
center than the late-type galaxies. 

Another analysis of the three-dimensional density profiles of 
the 2dFGRS and SDSS groups found by a "friend-of-friend" al- 
gorithm indicates a type segregation, namely a decrease of the 
early-type galaxy fraction at larger group-centric distan ce and 
a cor responding increase of the late-type fr action (.Diaz et al.l 
I2005h . At higher redshifts (0.7 < z < 1.5). ICoil et alJ (l2006h 
show that red galaxies are more centrally concentrated than blue 
galaxies in the galaxy groups extracted from the DEEP2 survey; 
this work uses yet another algorithm for group selection, based 
on the search for galaxy over-densities in redshift space which 
accounts for redshift-space distortions. 

These various results find confirmation in the thorough anal- 
ysis of Weinmann et al. (2006), based on the SDSS "halo-based" 
catalogue: the authors show that the fractions of early and late 
galaxy types not only vary with distance from the halo cen- 



20 



ter, but also with halo mass over the full mass range probed, 
with more massive halos having higher/lower fractions of early- 
type/late-type g alaxies (fWeinmann et al. 2006). Interestingly, 
IWeinmann et alj (j2006) find a flat distribution of intermediate- 
type galaxies as a function of mass and distance to the halo cen- 
ter, with types based on both color and specific star formation 
rate. 

We also note that the detected segregation effects in the dis- 
tribution of early-type and late-type galaxies within the dark 
matter halos are consistent with the type/density relationship, 
namely the trend for early-type galaxies to preferentially inhabit 
high-density regions. Although dense regions of a survey con- 
tain more galaxies that in the other regions, it is not obvious 
that th ey undergo stronger clustering. However. lAbbas & ShethI 
(12006 1) have shown that in high density regions of the SDSS, 
galaxies are more clustered than in low density regions, and this 
is valid at all scales from 0.1 to 30 ' Mpc. T his remarkable 
property is interpreted by Abbas & ShethI (12006.) as providing 
strong support to the hierarchical models, as it is well repro- 
duced by numerical and analytical models in which the entire 
effect is due to the correlation of galaxy properties with the mass 
of the parent halo, and to the fact that more massive halos popu- 
late dense regions. 

The t ype-density re l ations hip was clarified by the detailed 
study of iBlanton et alj (1200 5'). who found that color (present 
star formation rate) and luminosity (hence stellar mass, result- 
ing from the history of past star formation) are the two prop- 
erties most predictive of local density. Therefore, the detected 
segregation effects in the clustering of ESS galaxies for different 
spectral type (early-type versus late spiral) and luminosity (giant 
versus dwarf) are naturally expected. The uniqueness of the re- 
sults presented here is that we identify for the first time the joint 
type/luminosity clustering segregation effect in terms of the very 
galaxy types which correspond to the locally well known mor- 
phological types. 



9.3. The dwarf galaxy correlation function 

The third major result obtained by the present ESS analysis 
is the correlation function for the dwarf galaxies. This func- 
tion is measured for the first time, thanks to the separation 
of the dwarf galaxy component which the ESS allows, based 
on th e type specific luminosity functions (de La pparent et all 
l2003h . The projected-separation correlation function of the ESS 
dwarf galaxies can also be interpreted in terms of halo mem- 
bership, as it displays a clear 1-halo component which falls off 
at Tp > 0.3 /i"' Mpc. By their stronger clustering at all scales, 
the early-type galaxies appear as a key component of galaxy 
clustering. The auto-correlation function of the dwarf galaxies 
and their cross-correlation function with the early-type galax- 
ies indicate that they are the next contributor to galaxy clus- 
tering at small scales. The additional evidence, based on the 
cross-correlation analysis, that dwarf and late spiral galaxies are 
not well mixed at scales < 0.3 ' Mpc leads to a picture in 
which dwarf galaxies are confined to the densest, hence central 
parts of the halos, and are preferentially satellites of early-type 
galaxies. This is in agreement with the observation that in local 
groups and clusters of galaxies, the dwarf-to-giant galaxy ratio 
is an increasing f unction of the richness of the galaxy concen- 
tration df erguson & SandagellT99Tt iTrentham & Hodgkinll2002l: 
iTrentham & Tullvll2002l) . 

Most halo models parameterize the halo content in terms of 
a dom inant galaxy and it satellites (Berlind et al. 2003; Coorav 
120061) . In their analysis of SDSS data. .Zehavi et al.. (.2005^) per- 



form a two-component HOD modelling based on either red and 
blue central galaxies surrounded by red and blue satellite respec- 
tively. However, in the ESS, the dwarf galaxy sample is largely 
dominated by dwarf irregular hence blue galaxies, and these ap- 
pear as satellites of the early-type hence red galaxies. Moreover, 
the late spiral galaxies may play the role of central galaxies in 
the less massive halos, whereas in the more massive halos, they 
may be considered as satellite gala x ies. A nother subtle effect 
is that detected by IWeinmann et al.l (l2006l) in the relative dis- 
tribution of central and satellite galaxies in halos, which they 
name "galaxy conformity": for a halo of a given mass, the early- 
type fraction of satellites is significantly higher when the central 
galaxy is early-type rather than late-type. Altogether, these var- 
ious results indicate that reality may be more complex than the 
simple two-component HOD models. 

To illustrate the variety in galaxy types among a given halo, 
and their specific spatial distributions, let us consider our lo- 
cal group, which is typical of an intermediate-mass halo. It is 
dominated by the Milky Way, an Sb galaxy, and Andromeda, 
an Sab galaxy. In the ESS classification, the Milky Way would 
be classified as a late spiral, and Andromeda would be at 
the limit between early-type and late spiral. The third gi- 
ant, although smaller galaxy, M33, is an Sdm galaxy, and 
would be classified as a late spiral. The blue Sm/Irr satel- 
lites of the Milky Way, the Magellanic Clouds, and the red 
dE satellites of Andromeda, M32 and MHO, would all be 
classified as dwarf galaxies. There are in addition many dSph 
and dl galaxies in the local group, distributed at typically 
0.05 - 0.1 /z"' Mpc and 0.5 /i"' Mpc from the giant galaxies 
( http ://w w w. astro .Washington .edu/mayer/ LG/LG.htmlj ) . 



9.4. Perspectives 

The present analysis emphasizes the need for further studies of 
galaxy clustering as a function of galaxy type. This requires sta- 
tistical analyses of large galaxy samples effectively containing 
halos within a large mass range, and a detailed knowledge of 
their galaxy content as a function of galaxy mass, luminosity and 
type. The specific clustering of the dwarf galaxies evidenced in 
the present ESS analysis suggests that probing the dark halo con- 
tent in terms of the full sequence of giant and dwarf galaxy types 
would significantly enrich our understanding of galaxy cluster- 
ing. Higher signal-to-noise measurement of the galaxy corre- 
lation functions for the various giant and dwarf galaxy types, 
and interpretation using the "Halo Occupation Distribution" or 
"Conditional Luminosity Function" would bring new insight 
into their distribution within the dark matter halos, and the rela- 
tive role of the central and satellite galaxies in the halos. 

The ultimate goal when identifying the different segregation 
effects which galaxies undergo in a given halo, is to make a link 
with the past history of star formation and mass accumulation of 
each system. In such studies, the definition of the galaxy types 
will be important, and the choice of the classification method 
will have an decisive impact. The innovative approach of pro- 
gramme EFIGI at lAP (see http://terapix.iap.fr/|, aimed at ob- 
taining a quantitative morphological classification (Baillard etal. 
in preparation), should allow one to reliably classify large sam- 
ples of galaxies, hence to better understand how each morpho- 
logical type contributes to galaxy clustering. 
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Appendix A: Distances 

Redshifts z are converted into comoving distances r from the ob- 
server by using t the dimensionless radial comoving_coordinate 
of the Robertson- Walker line element tWeinberg.. 19721) : 



r 

with 



(A.l) 



Given the chosen flat geometry, the comoving separation be- 
tween any two objects / and j with angular separation 6 on the 
sky is expressed from the usual law of cosines as: 



cos 6 . 



(A.2) 



Appendix B: Estimators 

The galaxy-galaxy correlation function in redshift space ^{s) is 
defined as the probability in excess of a homogeneous Poisson 
distribution of finding in any direction two galaxies at distance s 
from each other: 



(B.l) 



where p is the mean spa ce number den sity of galaxies and is 
the volume element (see'Pe ebTeslll980 i). When the distribution is 
homogeneous, ^{s) = 0, but any uncertainty in the mean density 
of the galaxy sample p under study may result in an error in the 
correlation amplitude, especially at large spatial scales where the 
signal is below the fractional uncertainty in the density. To over- 
come this difficulty, together with the problem of selection and 
boundaries effects in the data sample, several estimators have 
been introduced which allow one to measure ^(s) from a finite 
set of objects with minimum bias and variance. They are gen- 
erally defined as suitably normalized ratios of counts of galaxy 
pairs separated by distance s in a narrow interval of distances 
6s centered on s. The various considered pair counts are: (i) the 
weighted number of pairs of observed galaxies 



DD(s) = S,-,,>,- wfwf; 



(B.2) 



(ii) the weighted number of pairs for a computer-generated ran- 
dom distribution with the same selection criteria as the galaxy 
sample (see Sect. |E]i 



RR{s) = Sy>; wf wf ; 



(B.3) 



and (iii) the weighted number of pairs between the set of random 
objects and the observed galaxies 



DR{s) = S,j>,- Wf'W] 



(B.4) 



Note that a given pair of objects (/, f) is only counted once in 
Eqs. lB.2IIB.3l and rB.4l The adopted functions for the weights 
and w\ are discussed in Sect. |D] 

In the following, we also denote Nd the number of observed 
galaxies in the data sample and A^r the number of points in the 
corresponding random set (see Sect.|E]i. 

For investigating the correlation properties of the ESO- 
Sculptor redshift survey, we consider three of the demon- 
strated best estimators of ^{s). The first estimator is that by 



iDavis & PeeblesI d 19831 denoted DP estimator hereafter). If we 
denote C*"" and C^^ the weighted object counts in the galaxy 
and random samples resp. (see Sect. |E]for the definition of these 
quantities), this estimator may be defined for large enough sam- 
ples (Nd,Nr » 1) as: 

CW DDis) 



l+^DP(^)-2 — 



(B.5) 



DRis)' 

with the sums in the pair counts extending over all indepen- 
dent pairs with redshift-space separations between s - 6s/2 
and s + 6s/2; x is the standard notation to refer to an estima- 
tor of quantity x. The DP estimator is poorly sensitive to the 
adopted edge correction but its variance varies as I /p. With its 
qua dratic dependenc e on the uncertainty in the mean density p, 
the Ha milton! (Il993h estimator (denoted H estimator hereafter) 
performs better than the DP estimator for sparse samples with 
a poorly determined mean density. The H estimator takes into 
account the pair count within the random sample according to: 

DD{s) X RRis) 

l+fiii(s)^4 — (B.6) 

which includes thereby a measure of the relative densities of the 
two catalogues at any separation, via the pair counts (indepen- 
dent pairs only); this allows one to bypass the density normal- 
ization factor present in Eq. IB. 5 1 

To minimize the_effects of the finite solid angle on the sky, 
iLandv & Szalavl (|J_993) introduced yet another quadratic estima- 
tor, denoted LS estimator hereafter: 

C« f DD(.s) CW DR(s~) 



l+fLs(.v)-2 + 



C(d) 



RR{s) RR{sy 



again, only independent pairs are counted. The authors show 
that this estimator performs very well with a nearly Poisson 
vari ance for uncorre cted data (for other clustering regimes, 
see iBernsteinI 11994 . and is less sensitive to the number 
of points in the ran dom distribution than the H estimator 
jKerscher et al.l |2000|) . Each estimator has its own theoretical 
advantages a nd we ak point s which dep end on the scale range 
under study (iPons- Borderi a et al.lll999l) . Even if recent analy- 
ses have shown that the 3 estimators agree within the error bars 



ses nave snown mat tne i estimators agree witnin tne erro r bars 
jTucker et all 1 19971: iGuzzo et al.l l2000t IZehavi etalj|2002; but 
see lLovedav et al.ll 1995b . here we choose to calculate the 3 esti- 
mators for each ESS sub-sample and to compare the estimates. 
This allows us to secure our conclusions on the behavior of the 
correlation function. 

Finally, we define the cross-correlation function between two 
different sub-samples. It measures the excess probability over 
random of finding a galaxy belonging to sample #2 at a separa- 
tion s from a galaxy belonging to sample #1. The same estima- 
tors as for the auto-correlation function, but with slightly modi- 
fied expressions and normalization factors can be used. The DP, 
H and LS estimators for the two-point cross-correlation can be 
written respectively as : 



1 + ^Dp(i) ^ 

1+|h(^)- 



DyD2{s) 



C^iOCCi.) ^ID,R2{s) DiRiis)' 

DiD2(s)xRiR2(s) 
DiR2is) D2Riis) ' 



(B.8) 
(B.9) 



C(ri)c(r2) DiD2(s) 

O^OO^ RiR2is) 

DiR2(s) _ DiRijs) 
RiR2is) RiRiis)' 



(B.IO) 
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where the D\D2is), R\R2{s) sums are the weighted numbers of 
all pairs with separations s + 5s 12, and the DiRzis), D2R\{s) 
sums are the weighted numbers of all cross-reference data- 
random and random-data pairs. We have checked that the three 
estimators in Eqs . IB . 8 1 to IB . 1 01 yield consistent measures for the 
various cross-correlation functions considered in Sect. | 

Appendix C: Selection functions 

In magnitude-limited surveys, the observed galaxy density varies 
strongly with distance r from the origin, because such surveys do 
not include all the galaxies within a limiting redshift distance, 
but only those bright enough to be detected. To calculate the 
correlation functions, one must account for this selection effect. 
The corresponding selection function is derived from the galaxy 
luminosity function, denoted (p{M). The probability that a galaxy 
at comoving distance r (see Sect.|A]i with absolute magnitude M 
is detected in a sample can be written as: 



p(M) 



Mr„i„,(r) 
'MbrighiC'-) 



0(M) dM 



(C.l) 



where Mbi-ight('") and Mfaint(r) are the brightest and faintest ab- 
solute magnitudes observable at distance r. The selection func- 
tion i/'(r) is then defined as the ratio between the number of the 
detectable objects at r and the total number of galaxies which 
would be observed in a homogeneous sample between absolute 
magnitudes Mi to Mj'- 



■min(Mrai„[(r),M2) 
lmax(Mbrigi„(r),M,) 



0(M) dM 



Cm) AM 



(C.2) 



Note that t/r(r) takes values in the interval [0, 1], with i/'(0) = 1 
and (/'(r) — > when r — > oo. 

Here, we use for M\ and M2 the effective boundaries 
(rounded to the first decimal place) of each considered sub- 
sample, in order to have the same distribution in absolute mag- 
nitude for the observed sample and the comparison random set 
(see Sect.lEji. The values of Mi and M2 adopted for each consid- 
ered ESS sub-sample are listed in the third column of Table[T] In 
the case of a sub-sample with a cut in absolute magnitude. Mi 
or M2 in Eq. |C.2| are replaced with the appropriate bound. 

Because only 92% of the ESS galaxies with R^ < 20.5, and 
52% with Rc < 21.5 have a measured redshift, we also include 
the redshift incompleteness in the calculation of the selection 
function. As the redshift incompleteness is uncorrelated with the 
position on the sky and only depends on the apparent magni- 
tude (see Ide Lapparent et al.ll2003h . we proceed as follows. We 
bin the redshift incompleteness in fixed intervals of 0.5 mag. in 
apparent magnitude. At each comoving distance r, we calculate 
the corresponding intervals in absolute magnitude and split the 
numerator integral in Eq. lC.2l into sub-integrals using these inter- 
vals; then in each sub-integral, the incompleteness is accounted 
for as a constant factor < 1 . 

Combined sub-samples including more than one class have 
their selection function defined as follows. The expected dis- 
tance distribution for a homogeneous distribution with a single 
spectral class is 



n^2 

N(r) = <Poip(r) I ' (p(M) dM 



(C.3) 



where ip{M) is the shape of the luminosity function, defined as 



for a Gaussian parameterization. We also use Eq. IC.4I for the 
composite luminosity functions of the ESS intermediate-type 
and late-type samples (see Sect. I2.2l i: then, the shape of the ad- 
ditive Schechter component contributed to (f{M) is scaled by 

By equating the total expected number of galaxies to the sum 
of the expected numbers for each sub-sample, we obtain 



(A(r) = 



^4=1 ^k(r) 4>ok niM) dM 
00 Q viM) dM 



(C.5) 



The integral in the denominator is unknown, as the parametric 
form of the luminosity function corresponding to the total sam- 
ple is a priori unknown. It can however be determined using the 
boundary condition that Eq. IC.5I must also be valid at r = 0, 
where all selection functions iff{r) and iA^t(r) are equal to unity 
(see Eq. lC.2l ). This yields 



iA(r) 



_ Sf^i Mr) <Pok Q n(M) dM 



(C.6) 



For ESS sub-samples with a cut in absolute magnitude, the se- 
lection function for a single spectral class (Eq. |C.2| ) is calculated 
with the modified values of the bounds Mi and M2. For ESS sub- 
samples from which is extracted a redshift interval, the selection 
function is set to zero in that interval. For both types of cuts, 
the selection function for a combined sample is derived using 
Eg.lCel 

Appendix D: Weights 

The selection functions described in Sect. |C] can be accounted 
for in the calculation of correlation functions by weighting each 
pair of galaxies in the various estimators of Sect.|B]according to 
three different schemes. When the weighting function is constant 



w{r) = 1 



(D.l) 



(denoted "equal pair" weighting), pairwise estimates of the cor- 
relation function are biased against the few distant galaxies. In 
contrast, weighting the galaxies in proportion to the inverse ra- 
dial selection function ij/ir) 



w{r) = l/^(r) 



(D.2) 



(denoted "equal volume" weighting) gives too small a weight 
to the well-sampled nearby regions where clustering dominates 
the galaxy shot noise. This leads to the introduction of the 
minimum-variance weighting scheme in which each object at 
distance r in a pair with separation s is applied a weight 



w(r, i) = 1 / [ 1 + ^npipir) J^is) ], 



(D.3) 



0(M) dM = 4>i)ip{M) dM 



(C.4) 



where AnJ^is) is the volume integral of the two-point correla- 
tion function ^(s) out to a separation 5; note that this approach 
can only be used if ^(s) vanishes on scales larger than some scale 
Sc- The minimum-variance weighting (also denoted 73 weight- 
ing) is intermediate between the two other weighting schemes: 
although i/'(r) increases at small values of r, the decrease of 73 
with r dominates and An p ij/(r) Jj,(s) <K 1 at small r, so that 
w(r, s) ~ 1; in contrast, at large values of r, An p tfr{r) Jiis) » 1 
and w(r, s) behaves as l/i/'(r). 

It was also shown that the 73 weighting scheme gives 
the minimum uncertainty in the clustering amplitude on scales 
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where ^(s) < 1 ( lEfstathioiilll9"8llSaunders et al.lll992l) . Eq.lDJ] 
results from a separable approximation of the true minimum- 
variance pair weighting which is valid in the linear regime ap- 
plicable at la rge separations, when higher-order statistics can 
be neglected (lHamiltonlll99l . The integral J^is) can be calcu- 
lated without involving any iterative technique by modeling the 
required correlation function with a power-law model and still 
yield accurate estimates of ^(s), especiall y if one uses unbiased 
estimators for ^(s ) (see Sect.|ll see also iRatcliffe et al.|[T998bt 
iGuzzo et aUbOOOl) . 

Here, we estimate Jiis) using the power-law model which 
provides a good fit to most observed samples 



as) = (s/so)- 



with 



r 

So 



= 1.6 

= 6r 



'Mpc 



(D.4) 



(D.5) 



measured from^ the existing redshift s urveys 



jde Lar)paren t et aLl 
Lovedav et al. ' 
Willmer et al 



T988t 



Maurogordato et al 



T992L 



1995; 'Hermit etal. "1996"; "Tucker et al." 199?; 

,^1998; Ratcliffe et al. 1998a; Zehavi et al. 2002; 

Hawkins et aLll20()3i A posteriori, this is also in acceptable 
agreement with the results for the ESS (see Eq.fTTTi. The power- 
law parameterization of Eq. ID.4I is used only for separations 
smaller than - 30 /i"' Mpc; we use ^(i) - otherwise. This 
yields 



his) = 12.6 s^ '^ h-^Mpc^ 
Ms) = 1468 h-^Mpc^ 



for 
for 



S < Sc 

S > Sr 



(D.6) 



Note that the ^3 weighting favors low-luminosity pairs at 
small separatio ns while lum inous objects dominate the estimate 
on large scales dGuzzo et al.ii200 0). The overall shape of the cor- 
relation function may then change in case of any luminosity de- 
pendence of the galaxy clustering. The ^3 weighting results must 
therefore be compared with those obtained in the "equal pak" 
weighting, in particular at small scales. 



then allows one to normalize the density of the random distri- 
bution to that of the data sample for the DP and LS estimators 
(Eqs. lB.5] and lB.7l in the H estimator of Eq. lBTSl the normalizing 
factor cancels out). This normalization of the observed number 
of pairs is equivalent to adopting the mean density for each ob- 
served sample as the reference density. 

Each random distribution is then generated by randomly 
drawing points with a redshift probability distribution defined 
by the selection function i/'(r) corresponding to the data sub- 
sample (Eq. |C.2t . The RA and Dec coordinates of each random 
point are also drawn randomly between the ESS extreme values 
while accounting for the small excluded RA and Dec regions due 
to saturated stars. For a sub-sample in Table [1] which is based 
on one spectral type and has cuts in either redshift or absolute 
magnitude, the number of observed objects A^d after applying 
the redshift or magnitude cut is listed in Table [1] and used in 
Eq. lE. II and the random distributions is generated using the cut- 
updated selection function for that spectral type (see Sect. 0. 
For the combined samples (for example the sample containing 
"all galaxies"), we use the reunion of the random sets corre- 
sponding to each spectral-type sub-sample and each satisfying 
Eq. IE. II which ensures that the selection functions and relative 
proportions for each spectral-type are taken into account. 

Then, from each observed sample and its corresponding ran- 
dom set, we calculate the data pairs counts DD{s) (Eq. |B.2| i and 
the comparison random pair counts DR{s) and RR{s) (Eqs. IB .41 
and lB.3b . In the case of "equal pair" or "equal volume" weight- 
ing, the normalizing ratio of weighted counts of objects which 
appear in the DP and LS estimators (see Eqs. IB. 51 and lB.7b is 
defined as 



s^Jl'i win) 



(E.2) 



where the sums run over the N^, objects of the random, 
resp. observed distributions, and the weights are defined in 
Eqs. ID. 21 and ID. 31 In the case of 73 weighting, the ratio of 
weighted pair counts in the DP and LS estimators is computed 
as 



Appendix E: Normalization 

Because the two-point correlation measures the excess number 
of pairs over a homogeneous distribution, it requires a normal- 
ization which is obtained by comparison of the number of pairs 
in a given ESS sample, with that derived from a mock homoge- 
neous distribution occupying the same volume as the ESS sam- 
ple, and having the selection function 4r(r) derived from the lu- 
minosity function of that sample. Because the redshift incom- 
pleteness is accounted for in the selection function i//(r) (see 
Sect. IC), it is automatically accounted for in the random dis- 
tributions, and does not need to be included into the weighting 
functions of Eqs. |DniD:2] and|D3] 

The Monte-Carlo set containing A^r points, and correspond- 
ing to each data sub-sample defined in Table |2] includes at least 
fifty times as many objects as the observational catalogue: 



M- =50A^d 
A^,- =5000 



for 
for 



A^d > 100, 
A^d < 100. 



(E.l) 



The number of random points A^, is then large enough to ensure 
that the fluctuation in C''' (see below) and the related uncertainty 
in ^s) are negligible, so that the uncertainties in the correla- 
tion function are dominated by those in the pair count DD(s) 
(see Eq. |B.2| i. The normalizing factor C'^'^VC*''' (defined below) 



cw _ Igi win, s,) 



with 



= 30 h-^ Mpc. 



(E.3) 



By fixing the value of the 73 weights at the large pair separation 
ic - 30 Mpc, we ensure that the weighted pair counts C*''^ 
and C^'' are not afi'ected by galaxy clustering. 



Appendix F: l\1ean density 

In the case of the 73 pair-weighting function (Eq. ID. 31) . one 
must define an estimator of the mean number density p. Given 
a magnitude-limited sample of A^ galaxies, we denote p(Mi < 
M < M2) the mean density of galaxies with absolute magni- 
tude M in the interval M\ < M < M2 (corresponding to the 
bounds used in the selection function, in Eq. |C.2| i. An estimator 
of p(Mi < M < M2) which is unbiased by the selection function 
ifrir) can be obtained using 



p(Mi < M < M2) 



i:f=i w(r,) 



j;-Mr)ifrir)fdr' 

min 



(El) 



where w(r) is a weighting function (see Eqs. |D.l||D.2| and |D.3l l. 
The comoving distances r^i^ and r^ax correspond to the redshift 
boundaries of the sample (Eq.[T]i. 
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iDavis & Huchral ( |1982|) showed that in the case of "equal 
pair" weighting (Eq. ID. It . this estimator is the most stable, 
but heavily weights galaxies near the peak of the redshift dis- 
tribution. In the case o f "equal volume" weighting (Eq. |D.2| l. 
iDavis & Huchral (Il982l) also showed that Eq. lF.ll is close to the 
minimum variance estimator, but that it heavily weights distant 
structures. The Jy, weighting defined in Eq. |D.3| provides an in- 
termediate estimate of the mean density. 

To estimate the mean density required for a ^3 pair-weighting 
(Eq. ID. 21 ). we iterate over Eqs. IF. 11 and ID. 31 The "equal vol- 
ume" weighting (Eq. ID. II ) is used for calculating a first value 
of p. Then, in each calculation of w(r), we use Eq. ID. 31 with 
Jsis) = 73(30 h-^ Mpc) = 1468 h-^ Mpc^ (see Eq. |D2]i, be- 
cause the estimate of p in Eq. lF.ll requires a weighting function 
with the comoving distance r as the only variable, whereas the 
Ji weighting function w(r, s) varies with both r and separation s; 
we thus ensure that the weights, and therefore the mean density 
estimate, are not affected by galaxy clustering. This yields for 
the 3 spectral-type sub-samples: 

p - 8.47 10"^ Mpc'^ for early - type 

p = 33.58 10"^ Mpc"^ for intermediate - type (F.2) 

p = 52.41 10"^ Mpc"-' for late - type 

With these values of p, 4;r p i//{r) 73(30) > 10 for r < 
1500 Mpc. As a result, w(r, i) oc 1 /ip{r), which corresponds 
to the "equal volume" weighting (Eq. lD.2l i. 

Appendix G: Projected correlation functions 

Peculiar velocities distort the redshift-space correlation function 
^(s), which then differs from the real-space correlation function 
^(r). In redshift-space, internal random motions within bound 
structures create the so-called "finger-of-god" structures (elon- 
gated along the line-of-sight), while coherent motions on large 
scales te nd to flatten the over -densities along the observer's line 
of sight dHawkins et al.ll2003 l). Moreover, the rms uncertainty of 
~ 1 .6 /1 ' Mpc on the line-of-sight separation caused by the red- 
shift measurement uncertainties in the ESS, also contributes to 
smooth out any clustering in redshift s pace on scales co mparable 
i < 3 /! ' Mpc (see §3.1 and Fig. 4 in lCole etalj|1994 . 

Because the redshift-space distortions are only radial, one 
can compute the correlation function as a function of separation 
parallel (n) and perpendicular (rp) to the line-of-sight, which al- 
lows one to disentangle the effects of peculiar velocities from 
the genuine spatia l correlations. Following the formalism of 
iFisher et"an (1 19941) . for any two galaxies with redshift positions 
Pi and P2, the redshift separation and line-of-sight vectors are 
defined as S s P2 - Pi and L s 0.5 x (Pi + P2), respectively. 
Therefore, the parallel and perpendicular separations are: 



7r = S-L/ |L|, 
r 2 = S ■ S - TT 



(G.l) 



The redshift-space correlation function ^(rp, n) can then be de- 
rived for each estimators by replacing DD(s), RR{s) and DR(s) 
in Eqs. |B3] |B2] and |BJ] with DD{r^,7i) RR(r^,7i) DR(r^,n), 
which refer to the data-data, random-random and data-random 
pair counts resp. at each value of (rp, ji). 

In a second stage, ^(rp, tt) allows one to derive the correlation 
function w(rp) as a function of projected separation rp, which is 
unaffected by redshift distortions ( Davi s & Peebles,1983.) . and is 
obtained by integrating ^(rp, n) over n: 



^(rp,7r)d7r = 2 V ^(rp,7r,)A„ 
V 



The s ummation yields an unbiased estimate of w(rp) dJing et al.l 
1998), which is related to the real-space correlation function f (r) 
by: 



w(rp) = 2j| ^( ^rl+y^)dy. 



(G.3) 



If ^(r) is modelled as a power-law ^(r) — (r/ro) '>', the integral in 
Eq. |G.3| can be calculated analytically, and yields: 



r(l/2)r(y/2-l/2) 

r(r/2) 



where r(x) is the Gamma function. 

The model parameters ro and y in Eq. 
minimizing the value of;^'^ defined as: 



X' 



ri2 



C7 



(G.4) 



4] are derived by 



(G.5) 



(G.2) 



where ^(r,) and cr, are the measured values of the correlation 
function and its rms fluctuation at a separation r,, assuming 
thereby that the correlation between ^(r,) values leads to a small 
enough bias on the final result. 
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